-- Logs begin at Wed 2022-08-31 11:35:26 UTC, end at Wed 2022-08-31 12:36:42 UTC. -- Aug 31 12:02:08.731485 dv-cinder-855359-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 31 12:02:08.739844 dv-cinder-855359-1-smb devstack@keystone.service[81670]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 31 12:02:08 2022] *** Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: nodename: dv-cinder-855359-1-smb Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: machine: x86_64 Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: clock source: unix Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: pcre jit disabled Aug 31 12:02:08.741891 dv-cinder-855359-1-smb devstack@keystone.service[81670]: detected number of CPU cores: 4 Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: current working directory: / Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: detected binary path: /usr/bin/uwsgi-core Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: your processes number limit is 47680 Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: your memory page size is 4096 bytes Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: detected max file descriptor number: 2048 Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: lock engine: pthread robust mutexes Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: thunder lock: enabled Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 31 12:02:08.742345 dv-cinder-855359-1-smb devstack@keystone.service[81670]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 31 12:02:08.784474 dv-cinder-855359-1-smb devstack@keystone.service[81670]: Python main interpreter initialized at 0x5568a87019c0 Aug 31 12:02:08.784474 dv-cinder-855359-1-smb devstack@keystone.service[81670]: python threads support enabled Aug 31 12:02:08.784474 dv-cinder-855359-1-smb devstack@keystone.service[81670]: your server socket listen backlog is limited to 100 connections Aug 31 12:02:08.784474 dv-cinder-855359-1-smb devstack@keystone.service[81670]: your mercy for graceful operations on workers is 90 seconds Aug 31 12:02:08.784849 dv-cinder-855359-1-smb devstack@keystone.service[81670]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 12:02:08.784942 dv-cinder-855359-1-smb devstack@keystone.service[81670]: *** Operational MODE: preforking *** Aug 31 12:02:08.785200 dv-cinder-855359-1-smb devstack@keystone.service[81670]: *** uWSGI is running in multiple interpreter mode *** Aug 31 12:02:08.785200 dv-cinder-855359-1-smb devstack@keystone.service[81670]: spawned uWSGI master process (pid: 81670) Aug 31 12:02:08.785407 dv-cinder-855359-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 31 12:02:08.790323 dv-cinder-855359-1-smb devstack@keystone.service[81670]: spawned uWSGI worker 1 (pid: 81686, cores: 1) Aug 31 12:02:08.790323 dv-cinder-855359-1-smb devstack@keystone.service[81670]: spawned uWSGI worker 2 (pid: 81687, cores: 1) Aug 31 12:02:08.790323 dv-cinder-855359-1-smb devstack@keystone.service[81670]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 12:02:13.125965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:02:13.125965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: from cryptography.utils import int_from_bytes Aug 31 12:02:13.126733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:02:13.126733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: from cryptography.utils import int_from_bytes Aug 31 12:02:13.126961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:02:13.126961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: from cryptography.utils import int_from_bytes Aug 31 12:02:13.127407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 12:02:13.127407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: from cryptography.utils import int_from_bytes Aug 31 12:02:13.176214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:02:13.176413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:02:13.176514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 12:02:13.176606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] command line args: [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:02:13.176686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 12:02:13.176865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:02:13.176945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] command line args: [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 12:02:13.177028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ================================================================================ {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:02:13.177142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 12:02:13.177286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] admin_token = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.177368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ================================================================================ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 12:02:13.177531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] config_dir = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.177624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] admin_token = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.177704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.177783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config_dir = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.177889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] config_source = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.177975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.178069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] debug = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.178156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] config_source = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.178268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] debug = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_config_append = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_config_append = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.180991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_dir = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_dir = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_file = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.181952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.182938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.183877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] publish_errors = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.184953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] publish_errors = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.185892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] standard_threads = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] standard_threads = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.186858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] use_journal = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] use_json = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_journal = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] use_stderr = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_json = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.187939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] use_syslog = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.188078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_stderr = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.188078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] use_syslog = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.188307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.188420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 12:02:13.188534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.188646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.188759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.188884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.189935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.190849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.191876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.192981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.193998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.194117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.194803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.194926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.195874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.196962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.197899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.198990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.199108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.199223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.199660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.199781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.199895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.200911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.201960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.202906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.203911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.204969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.205906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.206899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.207931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.208899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.209981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.210882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.211932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.212885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.213931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.external = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.214896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.external = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.password = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] auth.token = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.215998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.password = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] auth.token = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.216931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.217927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.218856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.219884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.220982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.221908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.222978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.223922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224666 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.224981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.225918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.226871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.227916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.228958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.229908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.230970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.231901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.232990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.233921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.234988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.235929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.236952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237666 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.237907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.238953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.239895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.240911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.241016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.241624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.241724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.241820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.241916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.241916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.242982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.243868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.244983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.245985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] role.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.246875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] role.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.247978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.248963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.249849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.250942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.251736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.252953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.253876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.254943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.255970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.256079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.256215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.256348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.256463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.256564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.256727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.257371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.257490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.257589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.257695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.257795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.257929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.258884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.connection = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.259905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.260921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.261993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.262948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.263852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.264048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:02:13.264158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.264566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.264943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.265262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.265564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.265821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.266084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.266355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.266600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 12:02:13.266774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 12:02:13.294880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.295103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.295334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.298927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.299164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.299395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.304290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.308339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.332953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.333184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.335385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.335623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.386670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.387326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.435482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.435715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.437128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.437366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.594324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.594552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.594737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.594827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.594976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.595860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.618969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.619714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.630472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.631077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.643637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.643871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.644989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81687) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.645074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.645213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.645433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.645650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81686) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 31 12:02:13.662311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.662412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.662543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:02:13.662622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:02:13.662850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.662975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.663075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:02:13.663182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 31 12:02:13.663343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.663464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.663608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.663736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.663871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.664155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.664285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.664557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.673790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.674898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.681639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.681954 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.684574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.684861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.684946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.685151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.685235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.685438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.685520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.685724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.685808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.685989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.686891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.687085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.687246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.687353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.687532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.687809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.711962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.713527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.713896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.714176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.715731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.716037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.719244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.719537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.719829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.720599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.720886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.721170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.726263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.726557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.727676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.727991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.730698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.730992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.731284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.731645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.731919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.732013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.732237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.732322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.732523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.732606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.732800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.732893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.733079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.735115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.735415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.735703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.750356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.750647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.751315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.751597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.754607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.755470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.758400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.758710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.759122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.759419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.762938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.763752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.766202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.766898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.769495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.769804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.769989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.770950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.771159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.771549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.787563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.787859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.788010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.788182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.788302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.788463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.788560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.788837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.795382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.795548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.797042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.797229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.798604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.798781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.798893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.799060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.801627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.801724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.801940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.802987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.814122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.814414 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.814500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.814702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.814786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.814985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.815135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.815270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.815427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.815551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.815718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.815846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.816029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.816331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.831993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.832731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.835600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.836427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.838516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.839327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.839997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.840814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.841537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.841765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.842066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.842436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.842725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.843036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.848694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.849610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.850123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.851127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.853038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.853341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.853632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.853914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.854163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.854460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.854752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.855036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.861862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.862155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.862440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.863025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.863318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.863609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.869887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81687) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.870174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.870460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.870736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.871008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.871120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81686) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 31 12:02:13.871277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.871408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.871549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.871697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.871827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.872939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.873136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.873219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.873426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.873517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81687) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.873784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.874065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.874334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.874605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.874888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81686) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 31 12:02:13.907906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568a87019c0 pid: 81687 (default app) Aug 31 12:02:13.909756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5568a87019c0 pid: 81686 (default app) Aug 31 12:02:13.911453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24daa59-327c-4c74-8543-e62a09a3cd13 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:13.911785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24daa59-327c-4c74-8543-e62a09a3cd13 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:13.912128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24daa59-327c-4c74-8543-e62a09a3cd13 None None] PATH_INFO: `/v3` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:13.916328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Wed Aug 31 12:02:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:20.551743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:20.552328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:20.552328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:20.556774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:20 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:02:20.562166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:20.562617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:20.562745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:20.636618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: INFO dbcounter [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] Registered counter for database keystone Aug 31 12:02:20.655709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:02:20.661833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writer thread running {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:02:20.837635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG passlib.handlers.bcrypt [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81687) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 12:02:20.838024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG passlib.handlers.bcrypt [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81687) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 12:02:20.895897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:20.897507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:21.023597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 31 12:02:21.461664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:21.557679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: INFO dbcounter [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] Registered counter for database keystone Aug 31 12:02:21.580061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG oslo_db.sqlalchemy.engines [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 12:02:21.586580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writer thread running {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 31 12:02:21.704976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1063fd-2ec9-419f-9b5a-41e0a97a0f06 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:21.709178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:21.709830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:21.710107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:21.710376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:21.718318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:21.770108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 12:02:21.770450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172aa71-bde1-4fe5-8fa1-57af54a1bcc1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:21.779804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Aug 31 12:02:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:02:21.785822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:21.802600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa28197-784c-42a0-9172-4e4527414618 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:21.807626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:21.808779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:21.809059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:21.809329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] PATH_INFO: `/v3/projects/b529accab54243219085160b7b1ac0c9` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:21.810923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] RBAC: Authorizing `identity:get_project(project_id=b529accab54243219085160b7b1ac0c9)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:21.863854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING keystone.common.rbac_enforcer.enforcer [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 31 12:02:21.864220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8d869-8465-4e43-92ec-9bc95a70552c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:21.869477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Wed Aug 31 12:02:21 2022] GET /identity/v3/projects/b529accab54243219085160b7b1ac0c9 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:23.730050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab69c-f47d-4e0f-a613-be9f16ec04e5 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:23.730660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab69c-f47d-4e0f-a613-be9f16ec04e5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:23.730660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cab69c-f47d-4e0f-a613-be9f16ec04e5 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:23.734738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:23.739925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:23.740371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:23.740631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:23.760362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:23.761880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:23.769617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 31 12:02:24.038707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cab69c-f47d-4e0f-a613-be9f16ec04e5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:24.050749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cab69c-f47d-4e0f-a613-be9f16ec04e5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:24.055593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7d62-f52f-4449-adc6-602298adadb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:24.056287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7d62-f52f-4449-adc6-602298adadb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:24.056570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7d62-f52f-4449-adc6-602298adadb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:24.056845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7d62-f52f-4449-adc6-602298adadb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:24.064463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d7d62-f52f-4449-adc6-602298adadb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:24.066241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d7d62-f52f-4449-adc6-602298adadb7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:24.075156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Aug 31 12:02:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 12:02:24.081816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:24.090883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab9650-5f45-4aea-8261-9760eebd225a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:24.095268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420e1df-a668-4a28-8c4f-8d38e78f201f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:24.095895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420e1df-a668-4a28-8c4f-8d38e78f201f admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:24.096221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420e1df-a668-4a28-8c4f-8d38e78f201f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:24.096515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420e1df-a668-4a28-8c4f-8d38e78f201f admin admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:24.097809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420e1df-a668-4a28-8c4f-8d38e78f201f admin admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:24.099681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420e1df-a668-4a28-8c4f-8d38e78f201f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:24.101781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Wed Aug 31 12:02:24 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:26.060823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529135b-2c68-4291-8b71-c1abb2915818 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.061337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529135b-2c68-4291-8b71-c1abb2915818 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.061432 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529135b-2c68-4291-8b71-c1abb2915818 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.062718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:02:26.067760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.068170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.068358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.087007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:26.088252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:26.094333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90a3f-3838-4abd-a42a-221d233643f9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.094628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90a3f-3838-4abd-a42a-221d233643f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.094908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce90a3f-3838-4abd-a42a-221d233643f9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.096279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:02:26.101868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.102155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.102430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.144268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG passlib.handlers.bcrypt [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81686) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 31 12:02:26.144662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG passlib.handlers.bcrypt [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81686) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 31 12:02:26.182127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 6/12] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:26.195116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:26.196775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:26.298862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 7/13] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:26.449184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:26.475698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:26.556146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878ceb0-15e7-4daa-a68d-9c06e62ad6ea None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:26.571002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:26.590204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:26.590843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.591125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.591401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.602534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:26.611590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:26.612590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:26.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:26.618986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:26.671379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33713c3-25d6-44a1-bb49-5359cc6e8d7f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:26.673936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:26.699974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:26.709828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:26.710698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.710978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.711251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.717837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac2cd-a3c7-4a2f-bdd9-72c5a82a11a5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:26.751069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:26.751672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.751978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.752254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.752923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:26.753225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:26.754644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:26.766902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 8/15] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:26.772498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:26.778832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:26.780464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:26.871000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d3ece7-ac84-4a6e-bd95-0c2146c0683c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:26.876853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 8/16] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:02:26.882485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:26.885262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:26.904410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:26.905040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:26.905322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:26.905592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:26.906719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:26.908215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:26.909779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:26 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:26.915743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:26.930713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:26.986939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a267b1f5-233c-4f24-b779-22edfe54bb65 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:27.016839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47fc2f4-493b-43ba-865f-b2d447d34547 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:27.019794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:27.020669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:27.020952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:27.021221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:27.039557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:27.041055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:27.050508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:27.051142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:27.051424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:27.051695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:27.052873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:27.054303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:27.056040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 10/18] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:02:27.058491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:27.059559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:02:27.060647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:02:27.060647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:02:27.060647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:27.060647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 9/19] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:02:27.061771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:27.066406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:27.123257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:27.142528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:27.161347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eba8d1-6c3a-4369-8042-46772a2469c1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:27.170186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39eae-cf45-469e-8d27-a518d41f7724 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:27.195075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:27.195670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:27.195963 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:27.196252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:27.196972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.domain.id=default, user.id=b390b55cc108476686d568ade50a7cec) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:27.197278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:27.198712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996fd42-436e-44f6-9347-47563a67e315 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:27.203405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:27.204034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:27.204316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:27.204589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:27.205230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:27.205400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 11/20] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Aug 31 12:02:27 2022] GET /identity/v3/role_assignments?user.id=b390b55cc108476686d568ade50a7cec&scope.domain.id=default&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:27.208298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:27.209755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd5cbb-de79-44cd-b2ca-956b129ea2c0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:27.229858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 10/21] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:29.435906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e9529-9bc8-4180-a1f6-219599dae59c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:29.436465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e9529-9bc8-4180-a1f6-219599dae59c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:29.436544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e9529-9bc8-4180-a1f6-219599dae59c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:29.438005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 12/22] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:29.443085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99a88-5628-4a7d-9218-481b3c53e5d0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:29.444087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99a88-5628-4a7d-9218-481b3c53e5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:29.444277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a99a88-5628-4a7d-9218-481b3c53e5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:29.468170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b4a99a88-5628-4a7d-9218-481b3c53e5d0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:29.469379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b4a99a88-5628-4a7d-9218-481b3c53e5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:29.567940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:29.674286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5571a-d498-45f0-a967-03c4cf089e3a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:29.674612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5571a-d498-45f0-a967-03c4cf089e3a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:29.674866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5571a-d498-45f0-a967-03c4cf089e3a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:29.676377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:29.694503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642478-9a56-44e8-b0bd-861e1c0d9eea None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:29.694731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642478-9a56-44e8-b0bd-861e1c0d9eea None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:29.694998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642478-9a56-44e8-b0bd-861e1c0d9eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:29.720085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c9642478-9a56-44e8-b0bd-861e1c0d9eea None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:29.721277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c9642478-9a56-44e8-b0bd-861e1c0d9eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:29.778397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:29.811783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 12/25] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:30.035136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6adca-3623-4a4b-8546-719d3b8c4335 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.035772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6adca-3623-4a4b-8546-719d3b8c4335 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.036260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6adca-3623-4a4b-8546-719d3b8c4335 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.038364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 14/26] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:30.044087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8d50-7a92-4ef3-8d00-1414733f2813 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.044616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8d50-7a92-4ef3-8d00-1414733f2813 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.045105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e8d50-7a92-4ef3-8d00-1414733f2813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.068040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-160e8d50-7a92-4ef3-8d00-1414733f2813 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:30.070070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-160e8d50-7a92-4ef3-8d00-1414733f2813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:30.121461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6adca-3623-4a4b-8546-719d3b8c4335 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:30.175262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:30.177358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0341a00-dcf7-416f-8246-f7473c28a8f3 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.179265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0341a00-dcf7-416f-8246-f7473c28a8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.180539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0341a00-dcf7-416f-8246-f7473c28a8f3 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.186685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 14/28] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:30 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:30.188142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.188653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.189121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.227600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:30.228756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:30.281651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6adca-3623-4a4b-8546-719d3b8c4335 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:30.353235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 15/29] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:30.356302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:30.357552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:30.358426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.360547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.361095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.385596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:30.395969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:30.396892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:30.397632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:30.402566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 15/30] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:02:30.408344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:30.420301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:30.429655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:30.534718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c42661-cd89-43fc-ab4d-fbaf6deabbbe None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:30.537117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027cc89e-df45-4c5f-8822-b2a05b3b90d8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:30.574674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:30.575313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.575588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.575859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.589127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:30.590870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:30.594663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:30.595493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.595986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.596476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.597393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:30.597907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:30.600347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ab5b1e50-e280-48fb-9370-170fb6329ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:02:30.607854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:30.608784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:02:30.609607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:02:30.609607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:02:30.609607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:30.609607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 16/31] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:30.615532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b714df5-e14d-48f3-8dff-44bcd23cc46a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.615532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b714df5-e14d-48f3-8dff-44bcd23cc46a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.615532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b714df5-e14d-48f3-8dff-44bcd23cc46a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.615532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 17/32] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:30.615532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b714df5-e14d-48f3-8dff-44bcd23cc46a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:30.617884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 16/33] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:30.618951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:30.707930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:30.737816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:30.750057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06525c-d0c3-422b-870d-1d83073ce767 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:30.755349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b714df5-e14d-48f3-8dff-44bcd23cc46a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:30.785905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:30.786629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.787434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.788047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.788962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:30.789265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:30.790650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29680917-d243-4f9b-924d-f837d71cbe00 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:30.792465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:30.793077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.793357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.793628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.794298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:30.795665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:30.810040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 17/34] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:30.811342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:30.811629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:30.811904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:30.830500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:30.831670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:30.907978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 18/35] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:30.907978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:30.921076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 18/36] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 31 12:02:30 2022] POST /identity/v3/roles => generated 225 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:30.928106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:31.040423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:31.102849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc059d-fc35-46ec-98ba-bc77251c6245 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:31.120643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cfb70-5671-4c84-996f-710fbfed4113 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:31.140402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:31.141098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.141377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.141685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.143458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:31.145413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:31.147877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 19/37] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:30 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:31.148927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:31.159343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:31.160111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.160386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.160668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.161346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:31.163580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:31.186999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 19/38] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 31 12:02:30 2022] POST /identity/v3/roles => generated 219 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:31.188746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:31.206555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:31.289952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bd307-49a3-4d9b-b53f-74d3ba760c88 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:31.325539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:31.333828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c49449c-5f8d-44a7-982a-d5fae5b51c72 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:31.338891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df07ed-01ab-49fa-9595-c8a1231e99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:31.339518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df07ed-01ab-49fa-9595-c8a1231e99bf None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.339798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df07ed-01ab-49fa-9595-c8a1231e99bf None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.340101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df07ed-01ab-49fa-9595-c8a1231e99bf None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.340764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df07ed-01ab-49fa-9595-c8a1231e99bf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:31.342339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df07ed-01ab-49fa-9595-c8a1231e99bf None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:31.375612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:31.376299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.376571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.376862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.378323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:31.379763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:31.381655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 20/39] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:31.382235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:31.464905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:31.489013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282fc068-bd4f-485c-a8a6-7afe8623e0a4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:31.525765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48f0cd-972d-4e9a-82bd-9d0a29582123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:31.526395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48f0cd-972d-4e9a-82bd-9d0a29582123 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.526679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48f0cd-972d-4e9a-82bd-9d0a29582123 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.526956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48f0cd-972d-4e9a-82bd-9d0a29582123 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.527640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48f0cd-972d-4e9a-82bd-9d0a29582123 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:31.529101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a48f0cd-972d-4e9a-82bd-9d0a29582123 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:31.544785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 31 12:02:31 2022] POST /identity/v3/roles => generated 223 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:31.546231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b680e1-cdc9-4c8f-b7f1-da8b9c765282 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.546533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b680e1-cdc9-4c8f-b7f1-da8b9c765282 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.546816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b680e1-cdc9-4c8f-b7f1-da8b9c765282 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.553229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 22/41] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:31.553229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b680e1-cdc9-4c8f-b7f1-da8b9c765282 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:31.604072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 20/42] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:02:31 2022] POST /identity/v3/projects => generated 301 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:31.604072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.604072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.604072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.642810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:31.645692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:31.706635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b680e1-cdc9-4c8f-b7f1-da8b9c765282 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:31.734551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 21/43] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:31.750455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:31.751134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:31.751416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:31.751695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] PATH_INFO: `/v3/domains/default/users/b390b55cc108476686d568ade50a7cec/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:31.756583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b390b55cc108476686d568ade50a7cec, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:31.756749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:31.763249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:31.776068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 23/44] 10.222.0.48 () {58 vars in 1361 bytes} [Wed Aug 31 12:02:31 2022] PUT /identity/v3/domains/default/users/b390b55cc108476686d568ade50a7cec/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:02:32.017539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:32.114375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7422fc0-df8f-411a-8d18-8801c4ad5c0d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:32.121955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:32.150179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37bad1-81a8-4e8c-a768-af7bc4d2f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:32.150818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37bad1-81a8-4e8c-a768-af7bc4d2f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:32.151107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37bad1-81a8-4e8c-a768-af7bc4d2f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:32.151383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37bad1-81a8-4e8c-a768-af7bc4d2f2d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:32.152522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37bad1-81a8-4e8c-a768-af7bc4d2f2d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:32.154160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37bad1-81a8-4e8c-a768-af7bc4d2f2d9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:32.155738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 22/45] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:32.161248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:32.259666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859916a6-ae12-4138-929d-ad2e03ba6b28 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:32.292733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226637ba-6d92-457a-b1cc-5e9ffa15f91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:32.293351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226637ba-6d92-457a-b1cc-5e9ffa15f91e None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:32.293635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226637ba-6d92-457a-b1cc-5e9ffa15f91e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:32.293910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226637ba-6d92-457a-b1cc-5e9ffa15f91e None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:32.294654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226637ba-6d92-457a-b1cc-5e9ffa15f91e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:32.296153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226637ba-6d92-457a-b1cc-5e9ffa15f91e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:32.324398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:02:32 2022] POST /identity/v3/projects => generated 312 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:33.669679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420cc4f-318c-415d-83f5-6fb18762982e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:33.670190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420cc4f-318c-415d-83f5-6fb18762982e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:33.670273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420cc4f-318c-415d-83f5-6fb18762982e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:33.671677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 23/47] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:33.676995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:33.677902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:33.678046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:33.696729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:33.698253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:33.745558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:33.769055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 25/48] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:34.041622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420cc4f-318c-415d-83f5-6fb18762982e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.144403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420cc4f-318c-415d-83f5-6fb18762982e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.178214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e9397-d0f2-487f-ba46-92488e4148b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.178846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9397-d0f2-487f-ba46-92488e4148b1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.179129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9397-d0f2-487f-ba46-92488e4148b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.179401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e9397-d0f2-487f-ba46-92488e4148b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.189411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e9397-d0f2-487f-ba46-92488e4148b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-091e9397-d0f2-487f-ba46-92488e4148b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:34.195429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:34.196302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:34.197068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 24/49] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:34.202660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.232031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92042c-3160-4ad3-885e-32c9841263e9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.232256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92042c-3160-4ad3-885e-32c9841263e9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.232537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92042c-3160-4ad3-885e-32c9841263e9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.233882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 25/50] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:02:34.238862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.239151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.239430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.257996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:34.259180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:34.285543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:34.307870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f1626-99ab-4edd-a872-bbaa95ef7c14 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.331475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 26/51] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:34.341864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.342481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.342763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.343040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.343725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:34.344071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:34.345486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:34.357851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 26/52] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:34.363185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.457057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f5d5-f697-464c-ae8b-f9ea0e4553b9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.489087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.489648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.490493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.490766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.491886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:34.493386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:34.494928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 27/53] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:34 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:34.500468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.595848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.629385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:34.644614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:34.700862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaed2f4-ddec-4e0f-93db-6cdd5f51cd65 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.703030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd7c9-39cb-434e-900a-bd3b80c40018 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.733462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.734088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.734366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.734631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.735641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.735848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:34.736315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.736601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.736879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.737329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:34.738001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:34.738898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 28/54] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:34.739541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:34.741181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:34.744384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.747132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:34.838704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:34.842177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a928da72-8759-4c9b-89b9-4b706fc3df18 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.845320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42ae6-f966-466d-9701-b1eac0f9fba4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:34.853916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:34.877073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cec1dd-465b-4186-8a80-5502eff20129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.877680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cec1dd-465b-4186-8a80-5502eff20129 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.877975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cec1dd-465b-4186-8a80-5502eff20129 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.878083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:34.878237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cec1dd-465b-4186-8a80-5502eff20129 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.878617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:34.878893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cec1dd-465b-4186-8a80-5502eff20129 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:34.879065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:34.879189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:34.879881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.domain.id=default, user.id=b390b55cc108476686d568ade50a7cec) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:34.880214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:34.880928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cec1dd-465b-4186-8a80-5502eff20129 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:34.882178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5845a5-fe37-4da9-a070-b99a7e53a53a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:34.890334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 28/56] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Aug 31 12:02:34 2022] GET /identity/v3/role_assignments?user.id=b390b55cc108476686d568ade50a7cec&scope.domain.id=default&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:34.913790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 29/57] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Aug 31 12:02:34 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:36.820078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1975-1798-4555-99a1-378cbf211d26 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:36.820622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1975-1798-4555-99a1-378cbf211d26 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:36.820622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def1975-1798-4555-99a1-378cbf211d26 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:36.821960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 29/58] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:36.827307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:36.827715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:36.827872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:36.845627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:36.846822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:36.912530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 30/59] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:37.178407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1975-1798-4555-99a1-378cbf211d26 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:37.275769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def1975-1798-4555-99a1-378cbf211d26 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:37.308841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dcedf2-2fdb-4fd5-bdc4-072507b1dbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:37.309462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcedf2-2fdb-4fd5-bdc4-072507b1dbef None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:37.309770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcedf2-2fdb-4fd5-bdc4-072507b1dbef None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:37.310013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dcedf2-2fdb-4fd5-bdc4-072507b1dbef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:37.311117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcedf2-2fdb-4fd5-bdc4-072507b1dbef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:37.312615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dcedf2-2fdb-4fd5-bdc4-072507b1dbef None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:37.314176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 30/60] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:37.320318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:37.396883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:37.415842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67180bd-2107-4dda-a885-d2a89754ee5e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:37.448258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1296b4c7-df67-4894-be37-6eaf600d9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:37.449054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b4c7-df67-4894-be37-6eaf600d9514 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:37.449334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b4c7-df67-4894-be37-6eaf600d9514 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:37.449607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1296b4c7-df67-4894-be37-6eaf600d9514 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:37.450252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b4c7-df67-4894-be37-6eaf600d9514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:37.451705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1296b4c7-df67-4894-be37-6eaf600d9514 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:37.477098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 31/61] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:02:37 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:40.426047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93309a72-06c2-481f-bcdb-c4b9145e1b74 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:40.426556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93309a72-06c2-481f-bcdb-c4b9145e1b74 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:40.426631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93309a72-06c2-481f-bcdb-c4b9145e1b74 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:40.428654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 31/62] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:40.446432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779b93-1505-4d14-bf08-1dd6b54d2f55 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:40.447338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779b93-1505-4d14-bf08-1dd6b54d2f55 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:40.447816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779b93-1505-4d14-bf08-1dd6b54d2f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:40.472757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a5779b93-1505-4d14-bf08-1dd6b54d2f55 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:40.474837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a5779b93-1505-4d14-bf08-1dd6b54d2f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:40.563062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 32/63] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:40.632684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c524-da42-40bd-b97f-a95fcaab2c53 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:40.633016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c524-da42-40bd-b97f-a95fcaab2c53 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:40.633239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0526c524-da42-40bd-b97f-a95fcaab2c53 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:40.634715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 32/64] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:40.640098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1d48-1a46-4cf6-97c9-1a09e6210e52 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:40.640842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1d48-1a46-4cf6-97c9-1a09e6210e52 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:40.641321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553d1d48-1a46-4cf6-97c9-1a09e6210e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:40.669008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-553d1d48-1a46-4cf6-97c9-1a09e6210e52 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:40.670548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-553d1d48-1a46-4cf6-97c9-1a09e6210e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:40.755299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:40.764088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 33/65] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:40.785721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ace54-8e0e-4095-9dfe-f4147166a139 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:40.786809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ace54-8e0e-4095-9dfe-f4147166a139 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:40.787276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ace54-8e0e-4095-9dfe-f4147166a139 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:40.789122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 33/66] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:40.793947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577c36-87a1-4256-8bc7-ebeaa71f7aeb None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:40.794447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577c36-87a1-4256-8bc7-ebeaa71f7aeb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:40.794916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577c36-87a1-4256-8bc7-ebeaa71f7aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:40.824964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9a577c36-87a1-4256-8bc7-ebeaa71f7aeb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:40.826476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9a577c36-87a1-4256-8bc7-ebeaa71f7aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:40.914973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 34/67] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:41.029388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ace54-8e0e-4095-9dfe-f4147166a139 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.079924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de102e-abdf-4607-a6ff-789b2f3ce425 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.080556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de102e-abdf-4607-a6ff-789b2f3ce425 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.081045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de102e-abdf-4607-a6ff-789b2f3ce425 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.082617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 35/68] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:41.088164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.088671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.089152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.099446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.109432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:41.110721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:41.170601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ace54-8e0e-4095-9dfe-f4147166a139 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.199777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 36/69] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:41.200670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.214563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea87a84-0877-4d26-b3fc-c80fbf3663b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.215997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87a84-0877-4d26-b3fc-c80fbf3663b6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.216743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87a84-0877-4d26-b3fc-c80fbf3663b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.217368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea87a84-0877-4d26-b3fc-c80fbf3663b6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.234364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea87a84-0877-4d26-b3fc-c80fbf3663b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7ea87a84-0877-4d26-b3fc-c80fbf3663b6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:41.241961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:41.242992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:41.243907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:41.247986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 34/70] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:41.247986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0489f99-65d0-460e-b2a9-abd990182b9b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.247986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0489f99-65d0-460e-b2a9-abd990182b9b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.247986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0489f99-65d0-460e-b2a9-abd990182b9b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.248296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 35/71] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:41.256473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.256473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.256473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.273766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.274466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:41.275827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:41.318100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcaf9b-35b1-4001-b32f-a6cd3bef36d0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.351051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 36/72] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:41.352946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.353581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.353853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.354125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.357227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.365656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:41.370566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:41.371426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:41.372212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:41.372847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.399568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.490512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ca29f-b0a6-4d16-85c4-a000e130eafb None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.492152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a516d8-47a1-4e92-998d-771d84eede6c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.510151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.531371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.531848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.532135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.532374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.532531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.532642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.532805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.533072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.533313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:41.533624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:41.535209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:41.543535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:41.548343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:41.548343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:41.548969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:41.549783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:41.550555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 38/75] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:41.555446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.653065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.659908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499c759-59e6-4905-9f38-9ae4ee28cf52 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.662355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253fcf5b-1e5f-4ab1-8f98-f96f966bd9de None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.694314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.694957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.695244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.695521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.706225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:41.709446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.710068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.710352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.710623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.711288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:41.711594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:41.711679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:41.712530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:41.713336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 39/76] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:41.713956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:41.716775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.726710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 38/77] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:41.726710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.756823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.817008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164200a8-7ee9-4104-ab24-4367aab45f10 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.827641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2a8bb-1ae9-41b3-bbde-bc56daf8a373 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.852776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.853408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.853688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.853965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.862361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:41.862999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:41.863329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:41.863603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:41.864318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:41.864622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:41.865997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:41.867012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:41.868511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:41.870117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 40/78] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:41.871658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.874190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 39/79] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:41.876861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:41.894088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.965072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:41.971597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb004-67d5-4888-9c94-39cbe9e4e503 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:41.979614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1620-08c8-49a5-b18c-17c7f1af7ecd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.006014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.010391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.010669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.010935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.012074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.013461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.013577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.014072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.014358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.014637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.015187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:42.015354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:42.015614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.015980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.017033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.029898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:42.029898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.103641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.125097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29126c-caa0-41f7-9b5e-0106fc48acef None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.128349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e8f26-9bfb-4e5d-bcc4-c05b979f89a2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.159000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.159613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.159898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.160206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.162129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.162823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.163116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.163394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.164555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.166022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.167845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 42/82] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:42.168409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.199142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.232590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.234038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.266709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f5add-6b25-498e-8c79-bf43f2b44f9e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.299486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.300146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.300432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.300710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.301832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.303281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.304890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 43/83] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:42.305629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.313401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.336526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 41/84] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:42.337447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.403572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.406998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb522c5-4e2c-4835-937e-bc2ee2330e1b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.435361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ead01-65d3-4b6d-b3fb-4493812743b5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.441163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.441771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.442060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.442335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.443602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.445107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.465192 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 44/85] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:02:42 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:42.465998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.470051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.470713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.471000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.471280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.472528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.474079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.475774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 42/86] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:42.476623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.536977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.585137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8824abd2-37b1-498b-8ebb-92b40ad07618 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.598243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a4fdc-7ccb-4f0c-845f-74e191f88bac None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.621651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.622272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.622560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.622835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.645025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.646170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.646454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.646731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.652923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.710366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.711489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.733131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:42.734023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:42.787304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.848289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 45/87] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:42.850019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.851345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 43/88] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:42.852227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:42.909945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:42.957045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864660b0-52d8-409e-9158-9a5e1a71cff0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.959877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b50ac6-1551-4d47-93d1-39518ced7b5b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:42.993763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.994386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.994673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.994950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.995845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:42.996634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:42.997103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:42.997447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:42.998681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.000242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.002333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 46/89] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.003200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.023063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:43.097525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.099612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.118119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dab60-743f-442f-95b0-f9b871102ee5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.144947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:43.160798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.161496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.161786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.162068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.163927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.165424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.167635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 47/90] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.168602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.219047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 44/91] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:43.220289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.275259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:43.312345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1887ed7-22a8-49b5-9ba3-2747e072ed6e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.333950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b90691-2589-40c2-a77f-a2fcf7f35f25 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.359428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.360018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.360310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.360959 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.362362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.364758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.366816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 48/92] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.368105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.372805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.373658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.374140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.374666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.375628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=06f394ef75aa4bb29baa1d6359d2a84f) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:43.376197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.377849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.384075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 45/93] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/role_assignments?user.id=06f394ef75aa4bb29baa1d6359d2a84f&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=f0d96f0a9747490886f58f738e516776 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.385126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.483749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:43.563655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c7f896-7bb6-4a80-bbcf-58401e89bfe0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.585988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45377f77-17ed-4307-82b9-8687ef7d63cc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.602301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:43.616752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.618209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.618712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.619183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.620150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=b390b55cc108476686d568ade50a7cec) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:43.620714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.622557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.631095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 49/94] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/role_assignments?user.id=b390b55cc108476686d568ade50a7cec&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.631245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.631551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.631723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.632055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] PATH_INFO: `/v3/projects/b4a19f0186b441d5993337686c95ce50` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.633132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.633309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] RBAC: Authorizing `identity:get_project(project_id=b4a19f0186b441d5993337686c95ce50)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.634864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.637094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 46/95] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/projects/b4a19f0186b441d5993337686c95ce50 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.646246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:43.777999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6d9f3-7b6a-4746-bd05-74d25a8f6082 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.818602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.819237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.819525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.819808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.820794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=b4a19f0186b441d5993337686c95ce50, user.id=06f394ef75aa4bb29baa1d6359d2a84f) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:43.821118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.823079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56366788-4501-4d39-ab93-5743ad5d828a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.830204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 47/96] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/role_assignments?user.id=06f394ef75aa4bb29baa1d6359d2a84f&scope.project.id=b4a19f0186b441d5993337686c95ce50&role.id=f0d96f0a9747490886f58f738e516776 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:43.840885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422f600-a7d7-4933-ba10-ef872980bf17 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:43.877436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:43.892372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:43.893238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:43.893669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:43.894117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:43.895001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] RBAC: Adding query filter params (role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=06f394ef75aa4bb29baa1d6359d2a84f) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:43.896013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:43.897634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70dd400-c12f-4e02-8dd9-e6a99e27f19b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:43.906359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 50/97] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:43 2022] GET /identity/v3/role_assignments?user.id=06f394ef75aa4bb29baa1d6359d2a84f&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:44.816524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db312fd-50ba-455e-9b8d-60d62f61201c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:44.817062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db312fd-50ba-455e-9b8d-60d62f61201c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:44.817062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db312fd-50ba-455e-9b8d-60d62f61201c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:44.818990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 48/98] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:44.829447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:44.829920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:44.829998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:44.860972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:44.862209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:44.903202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95f784-18dd-46d1-abd3-02d14f373b9c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:44.903530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95f784-18dd-46d1-abd3-02d14f373b9c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:44.903777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95f784-18dd-46d1-abd3-02d14f373b9c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:44.905168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 49/99] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:02:44.911382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:44.911674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:44.911971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:44.937737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:44.939238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:44.985211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 51/100] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:45.004326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:45.032501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 50/101] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 31 12:02:45.365965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:45.468334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549f211-f8e6-436e-a83f-4b67c962a40e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:45.486109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:45.504009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:45.504674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:45.505027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:45.505299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:45.515777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:45.521398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:45.522316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:45.523067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 52/102] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:45.529805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:45.540824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:45.696772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1d0cf-919f-4445-9f49-147bc3d03bce None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:45.702338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e6de7-d683-47f0-b4e1-ca6d5b5886c8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:45.759147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:45.759778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:45.761459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:45.762152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:45.762764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:45.763043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:45.763314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:45.764003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:45.764308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:45.765304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:45.766478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:45.768179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:45.769632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:45.771539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 53/103] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:45.777847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:45.784775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 51/104] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:45.790553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:45.851114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:45.865070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:45.909685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e8da2-a2be-42f5-b23a-b9be4dbf0cec None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:45.945443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:45.946361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:45.946853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:45.947280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] PATH_INFO: `/v3/users/f7932a25572d49819198a59999ad5def` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:45.963998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] RBAC: Authorizing `identity:get_user(user_id=f7932a25572d49819198a59999ad5def)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:45.965664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:45.967704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 52/105] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:45 2022] GET /identity/v3/users/f7932a25572d49819198a59999ad5def => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:45.973079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:46.011873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c818918-d885-43a0-817a-6dea840124ee None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:46.080093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3958ad08-d887-4403-afbd-68b7add6a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:46.080093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ad08-d887-4403-afbd-68b7add6a7f0 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.080093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ad08-d887-4403-afbd-68b7add6a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.080093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3958ad08-d887-4403-afbd-68b7add6a7f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.080501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ad08-d887-4403-afbd-68b7add6a7f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:46.080825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3958ad08-d887-4403-afbd-68b7add6a7f0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:46.130450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 54/106] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:02:45 2022] POST /identity/v3/projects => generated 302 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:02:46.134993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:46.157770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db448a7-bdeb-4c58-a989-27d588860a3f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:46.208547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:46.209417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.209843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.210263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.225288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e319-7271-433b-b7db-4966c2012a96 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.225898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e319-7271-433b-b7db-4966c2012a96 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.226391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945e319-7271-433b-b7db-4966c2012a96 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.228035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 55/107] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:02:46.234622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d221fb-18ff-442f-8e34-ab687b3084b0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.235346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d221fb-18ff-442f-8e34-ab687b3084b0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.236239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d221fb-18ff-442f-8e34-ab687b3084b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.269091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-91d221fb-18ff-442f-8e34-ab687b3084b0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:46.270907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-91d221fb-18ff-442f-8e34-ab687b3084b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:46.304064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:46.305628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:46.440857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:46.456977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 53/108] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:02:46.460994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 56/109] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:46.465294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:46.595199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de46e0b-a8cb-4e23-8d27-1d1d206ac6f0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:46.601869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143792a-39b1-42af-878a-111044e53c36 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.602422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143792a-39b1-42af-878a-111044e53c36 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.602916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4143792a-39b1-42af-878a-111044e53c36 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.604516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 57/110] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:46.610994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902ac5d-c584-4cbc-8d68-3a98674b6f88 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.611548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902ac5d-c584-4cbc-8d68-3a98674b6f88 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.612036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902ac5d-c584-4cbc-8d68-3a98674b6f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.633143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a902ac5d-c584-4cbc-8d68-3a98674b6f88 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:46.634657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a902ac5d-c584-4cbc-8d68-3a98674b6f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:46.648156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:46.648811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.649098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.649380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.656686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:46.658178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:46.660220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:46 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:46.669175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:46.678188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:46.717032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 58/112] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:46.790561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:46.844774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69e08d-d75c-4a2d-a5d1-0c0f1262fcc0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:46.897249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:46.897905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.898154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.898435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.899179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] RBAC: Adding query filter params (role.id=a6c19d4f16a64be19e81d828569765ed, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=f7932a25572d49819198a59999ad5def) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:46.899494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:46.901002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d6990-d760-4775-9a33-bd693e2ed4a2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:46.912703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 55/113] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:46 2022] GET /identity/v3/role_assignments?user.id=f7932a25572d49819198a59999ad5def&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=a6c19d4f16a64be19e81d828569765ed => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:46.929116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3afd-f405-4be8-b146-cc6e9eb3754d None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.930075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3afd-f405-4be8-b146-cc6e9eb3754d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.930545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a3afd-f405-4be8-b146-cc6e9eb3754d None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.932257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 59/114] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:46.937989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:46.938280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:46.938563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:46.965801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:46.967099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:47.043447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 56/115] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:47.135421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a3afd-f405-4be8-b146-cc6e9eb3754d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.209299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.261611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a3afd-f405-4be8-b146-cc6e9eb3754d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.332142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:47.351489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c28c1c9-a16c-46bc-a6ec-60e0841a4208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:47.352146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c1c9-a16c-46bc-a6ec-60e0841a4208 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.352429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c1c9-a16c-46bc-a6ec-60e0841a4208 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.352704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c28c1c9-a16c-46bc-a6ec-60e0841a4208 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.368746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c28c1c9-a16c-46bc-a6ec-60e0841a4208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-5c28c1c9-a16c-46bc-a6ec-60e0841a4208 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:47.374576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:47.375417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:47.376214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:47.378918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 60/116] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:47.381518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c768b0-2a80-47fe-93ae-890228c8e516 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.382039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c768b0-2a80-47fe-93ae-890228c8e516 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.382519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c768b0-2a80-47fe-93ae-890228c8e516 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.384198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 61/117] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:47.385265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c768b0-2a80-47fe-93ae-890228c8e516 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.395421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509cff6-0c02-4386-a967-7c9b166e8e37 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.408374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:47.436655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:47.437839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.438346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.438821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.451616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:47.457501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:47.458443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:47.459213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:47.461654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 57/118] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:02:47.462850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.501133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c768b0-2a80-47fe-93ae-890228c8e516 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.540664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a275e2f-a31c-41c3-a157-f6fe3a2e7e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:47.541687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275e2f-a31c-41c3-a157-f6fe3a2e7e2a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.542222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275e2f-a31c-41c3-a157-f6fe3a2e7e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.542797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a275e2f-a31c-41c3-a157-f6fe3a2e7e2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.555193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a275e2f-a31c-41c3-a157-f6fe3a2e7e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-2a275e2f-a31c-41c3-a157-f6fe3a2e7e2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:47.560897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:47.561765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:47.562533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:47.565018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 62/119] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:47.571872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.572602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.573148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.585073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a140f77-86e7-4a89-9e84-92394cc750b2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.594817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:47.596531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:47.601904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:47.628278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:47.628901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.629426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.629736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.631125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:47.631440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:47.633636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:47.644812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 58/120] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:47.646244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.678209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 63/121] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:47.679068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.706267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:47.772447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0891be9-93e9-46be-be8c-57db474d2c77 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.812395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:47.813519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.813809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.814084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.814815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:47.815120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:47.816792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:47.827671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 59/122] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:47.828646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:47.874455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:47.889538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cd6e8b-8a2f-4a64-97ae-0b7ba34ea00f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.961434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610c808-0b45-420f-af17-7599cffe5399 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:47.997078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:47.997891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:47.998245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:47.998526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:47.999726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.001344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.003227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 60/123] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.004222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.020735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.021379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.021674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.021956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.022645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:48.022954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.024387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.040873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.041710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.124195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:48.143275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445968af-7016-4302-95a8-e651fda88dd9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.152354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:48.159640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf75d4e-307c-46b4-9a69-97061f323591 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.188894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.189926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.190649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.191203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.193252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.195032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.195846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.196517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.196805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.197084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.197675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.198482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.198975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.200165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.206824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.207819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.323845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022bfa4-ac42-4c7c-bf5b-361a06e7e4eb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.329317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a5124-d10e-46da-89ba-c56a61e02a3e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.361219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.361864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.362288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.362517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.363765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.365868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.367735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 62/127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.371996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.372679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.373095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.373546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.374003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.382503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:48.388629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:48.396051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:48.396916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:48.397702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:48.400086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 66/128] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:48.400674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.430800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:48.502678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad12ef7d-eee9-43db-a466-710482294b2f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.517500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08930032-2946-4799-b6b0-8a44066666fa None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.546993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.548103 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.548799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.549512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.551017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.553037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.553573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.554362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.554785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.555166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/06f394ef75aa4bb29baa1d6359d2a84f/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.555487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 63/129] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.556513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.563979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] RBAC: Authorizing `identity:create_grant(project_id=7033bee3fb7a4a80a25d41a8098a348d, user_id=06f394ef75aa4bb29baa1d6359d2a84f, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.563979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.581688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 67/130] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:02:48 2022] PUT /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/06f394ef75aa4bb29baa1d6359d2a84f/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:02:48.588909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.700975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:48.726524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff4fd9-4c67-4303-8c59-0d23e439196c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.742600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:48.764709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce7d828-83ee-4294-90d6-c7ea0578e8db None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.773996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.774710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.775054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.775714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.776690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.778271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.780400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 64/131] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.781209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.808475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.809099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.809383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.809652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.810500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:48.810808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.812560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27be853-617b-4722-bb48-884be0b3da9a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.823522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 68/132] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:48.825008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead41f3-1be1-4cd8-95f1-7f3aa67872b4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.825295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead41f3-1be1-4cd8-95f1-7f3aa67872b4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.825573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead41f3-1be1-4cd8-95f1-7f3aa67872b4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.830927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 69/133] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:48.830927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead41f3-1be1-4cd8-95f1-7f3aa67872b4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.916561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223eb27-d10c-4470-af2c-fe733cd945f8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.964936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:48.966334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:48.966835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:48.967354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/06f394ef75aa4bb29baa1d6359d2a84f/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:48.967843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead41f3-1be1-4cd8-95f1-7f3aa67872b4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:48.970058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=7033bee3fb7a4a80a25d41a8098a348d, user_id=06f394ef75aa4bb29baa1d6359d2a84f, role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:48.972563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:48.991103 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:02:48 2022] PUT /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/06f394ef75aa4bb29baa1d6359d2a84f/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:02:48.992312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:48.999656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:49.033081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754aaa82-ca57-4390-86ef-c24edaef0b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:49.035241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aaa82-ca57-4390-86ef-c24edaef0b28 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.036472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aaa82-ca57-4390-86ef-c24edaef0b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.039697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754aaa82-ca57-4390-86ef-c24edaef0b28 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/b390b55cc108476686d568ade50a7cec/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.042245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aaa82-ca57-4390-86ef-c24edaef0b28 None admin] RBAC: Authorizing `identity:create_grant(project_id=7033bee3fb7a4a80a25d41a8098a348d, user_id=b390b55cc108476686d568ade50a7cec, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:49.045376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754aaa82-ca57-4390-86ef-c24edaef0b28 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:49.076114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 70/135] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:02:48 2022] PUT /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/b390b55cc108476686d568ade50a7cec/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:02:49.078105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff72bf6-d727-4ad5-94a4-82d5b4a2a076 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.078713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff72bf6-d727-4ad5-94a4-82d5b4a2a076 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.079190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff72bf6-d727-4ad5-94a4-82d5b4a2a076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.090984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:49.116234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5ff72bf6-d727-4ad5-94a4-82d5b4a2a076 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:49.117455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5ff72bf6-d727-4ad5-94a4-82d5b4a2a076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:49.227601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9296d01-6c38-4347-8218-177c974ba3b1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:49.255109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 71/136] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:49.257019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25dab-7fc1-44a9-af0d-26de4f87d7de None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.257472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25dab-7fc1-44a9-af0d-26de4f87d7de None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.257887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b25dab-7fc1-44a9-af0d-26de4f87d7de None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.259534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 72/137] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:49.265418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.265863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.266299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.267878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:49.268558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.268839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.269159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.270915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:49.272419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:49.274287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 66/138] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:48 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:49.279810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:49.288906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:49.290413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:49.386487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 73/139] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:49.405346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbf1dd-5d48-40dc-96ce-03e86b930e2a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:49.412745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:49.440560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:49.441201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.441482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.441752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] PATH_INFO: `/v3/projects/b4a19f0186b441d5993337686c95ce50` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.442972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] RBAC: Authorizing `identity:get_project(project_id=b4a19f0186b441d5993337686c95ce50)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:49.444471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:49.446401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 67/140] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:49 2022] GET /identity/v3/projects/b4a19f0186b441d5993337686c95ce50 => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:49.452467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:49.498805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:49.568121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecef139-5953-4516-82ba-525d3fa0d8d1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:49.612702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:49.613413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.613700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.614569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] PATH_INFO: `/v3/projects/b4a19f0186b441d5993337686c95ce50/users/06f394ef75aa4bb29baa1d6359d2a84f/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.616617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4a19f0186b441d5993337686c95ce50, user_id=06f394ef75aa4bb29baa1d6359d2a84f, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:49.618096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:49.635169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 74/141] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:02:49 2022] PUT /identity/v3/projects/b4a19f0186b441d5993337686c95ce50/users/06f394ef75aa4bb29baa1d6359d2a84f/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:02:49.718316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:49.722648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:49.903273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73aaae-12da-449a-a4df-c38c7a61c01a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:49.925570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1ebf5-c774-473d-b5b2-ee99166c5f92 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:49.928393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:49.990653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:49.991929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.992400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.992665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:49.993000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.993321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:49.993605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:49.993879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:49.999671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:50.001496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:50.003595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 68/142] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:50.009713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:50.015426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:50.028762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:50.029835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:50.030775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 75/143] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:02:50.039970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:50.077749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:50.208354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624bb6-a908-4532-ac31-3a6844ac093e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:50.211258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2b75a7-1a3a-4dee-8f3c-1d1caeaf1e2d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:50.273864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:50.274495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:50.274776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:50.275186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:50.275921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:50.276242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:50.277635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:50.292862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 76/144] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:50.295696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:50.296361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:50.296656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:50.297022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:50.297701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:50.298103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:50.299208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:50.344294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:50.347555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 69/145] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:02:50 2022] POST /identity/v3/users => generated 283 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:02:50.463663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834bc3-da30-4430-9c0b-0dca181d84e3 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:50.515739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:50.516445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:50.516727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:50.517004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] PATH_INFO: `/v3/users/f7932a25572d49819198a59999ad5def` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:50.520716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] RBAC: Authorizing `identity:get_user(user_id=f7932a25572d49819198a59999ad5def)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:50.522219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:50.524247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 77/146] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:50 2022] GET /identity/v3/users/f7932a25572d49819198a59999ad5def => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:50.529900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:50.683071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:50.689066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11f1ef4-5697-49a9-a670-04e3a2b7f334 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:50.734157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8fc6ec-1b61-4be3-bccc-f024fca9dca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:50.734728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fc6ec-1b61-4be3-bccc-f024fca9dca5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:50.735010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fc6ec-1b61-4be3-bccc-f024fca9dca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:50.735286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8fc6ec-1b61-4be3-bccc-f024fca9dca5 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:50.736478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fc6ec-1b61-4be3-bccc-f024fca9dca5 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:50.737950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8fc6ec-1b61-4be3-bccc-f024fca9dca5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:50.740157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 70/147] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:50 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:50.745956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:50.900320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:50.901287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90819f6f-42f9-4d10-9926-e130054349c3 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:50.954613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b0be3e-b226-4e3d-a31c-423564279f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:50.954613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0be3e-b226-4e3d-a31c-423564279f66 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:50.954613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0be3e-b226-4e3d-a31c-423564279f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:50.954613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0be3e-b226-4e3d-a31c-423564279f66 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/f7932a25572d49819198a59999ad5def/roles/a6c19d4f16a64be19e81d828569765ed` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:50.956372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0be3e-b226-4e3d-a31c-423564279f66 None admin] RBAC: Authorizing `identity:create_grant(project_id=7033bee3fb7a4a80a25d41a8098a348d, user_id=f7932a25572d49819198a59999ad5def, role_id=a6c19d4f16a64be19e81d828569765ed)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:50.959976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b0be3e-b226-4e3d-a31c-423564279f66 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:50.984357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 78/148] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:02:50 2022] PUT /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/users/f7932a25572d49819198a59999ad5def/roles/a6c19d4f16a64be19e81d828569765ed => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:02:51.315929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb6d1-b737-40be-ae94-2ff984d6db96 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.316462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb6d1-b737-40be-ae94-2ff984d6db96 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.316536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bb6d1-b737-40be-ae94-2ff984d6db96 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:51.318381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 71/149] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:51.325217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd47ba-8772-4d46-953d-0c9028f95df3 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.325771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd47ba-8772-4d46-953d-0c9028f95df3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.325771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd47ba-8772-4d46-953d-0c9028f95df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:51.346897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a1fd47ba-8772-4d46-953d-0c9028f95df3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:51.348265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a1fd47ba-8772-4d46-953d-0c9028f95df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:51.422919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 79/150] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:51.729126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b18a6-4a16-40f3-8e46-260c80ffd6b5 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.729457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b18a6-4a16-40f3-8e46-260c80ffd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.729628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951b18a6-4a16-40f3-8e46-260c80ffd6b5 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:51.731244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 72/151] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:51.737466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397874c-5eb4-4ee1-bffe-05b8914d8acd None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.737759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397874c-5eb4-4ee1-bffe-05b8914d8acd None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.738039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397874c-5eb4-4ee1-bffe-05b8914d8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:51.765013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f397874c-5eb4-4ee1-bffe-05b8914d8acd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:51.766272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f397874c-5eb4-4ee1-bffe-05b8914d8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:51.769417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b18a6-4a16-40f3-8e46-260c80ffd6b5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:51.868458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 80/152] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:51.894536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8209ff7-622a-4820-8d77-46b7dada411f None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.894829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8209ff7-622a-4820-8d77-46b7dada411f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.895174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8209ff7-622a-4820-8d77-46b7dada411f None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:51.896781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 81/153] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:51.902248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.902535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.902817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:51.928120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:51.929429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:51.929662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951b18a6-4a16-40f3-8e46-260c80ffd6b5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:51.932772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:51.994389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:51.994956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:51.995243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:51.995523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:52.013560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:52.019484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:52.020939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:52.021697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 73/154] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:52.030352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:52.070424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 82/155] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:52.112256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:52.174299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5b1a2-b75d-4f26-ae49-d6476942b563 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:52.226967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:52.227589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:52.227869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:52.228172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:52.228909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:52.229215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:52.230671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:52.243674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 74/156] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:52.249285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:52.385032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2cee5-a115-4a53-9471-9249f95029de None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:52.403712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:52.455942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:52.456607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:52.456888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:52.457164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:52.458431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:52.459906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:52.461526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 83/157] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:52 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:52.478887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:52.495767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:52.578621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:52.600647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e616c4b-8b12-4a3d-a967-1b012672e123 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:52.659628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:52.661213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:52.663356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:52.663835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:52.690730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:52.700835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:52.701911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 75/158] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:02:52.702779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:52.722308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59950a6-2232-4a96-b93e-79db19229ccd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:52.779418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:52.780063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:52.780337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:52.780606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:52.928047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88493c-9cff-4877-9603-f58eafcabe0c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:52.949763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:52.951306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:52.966900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:52.980301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:52.982322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:52.982810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:52.983280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.001924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:53.007721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:53.008672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:53.009496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:53.011850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 76/159] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:02:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:53.015975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.034474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:53.120506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 84/160] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:53.124771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.151868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811171d-a446-43ed-8944-ab852b5b2842 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.230489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:53.231046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.231320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.231589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.232289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:53.232590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:53.233998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7bbb5-a8a4-49c9-8743-a281d755a662 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:53.251086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 77/161] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:53.255442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1855f33-7a65-43c4-a42c-09da73ed7c88 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.255734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1855f33-7a65-43c4-a42c-09da73ed7c88 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.257382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1855f33-7a65-43c4-a42c-09da73ed7c88 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.258660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 78/162] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:53.263122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1855f33-7a65-43c4-a42c-09da73ed7c88 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.290560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b34b44-919e-4404-abd7-b23952f15b00 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.310460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:53.362340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:53.362957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.363237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.363510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.364340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:53.364645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:53.367384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:53.386410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 85/163] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:53.387266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.406088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:53.440175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1855f33-7a65-43c4-a42c-09da73ed7c88 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.475747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4905a87-6651-41fd-97bb-7605e0e55dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:53.476418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905a87-6651-41fd-97bb-7605e0e55dca None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.476700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905a87-6651-41fd-97bb-7605e0e55dca None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.476972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4905a87-6651-41fd-97bb-7605e0e55dca None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.479799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905a87-6651-41fd-97bb-7605e0e55dca None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:53.480038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4905a87-6651-41fd-97bb-7605e0e55dca None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:53.481922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 79/164] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:53.483191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.483481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.483759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.504777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:53.506673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:53.567663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf4909b-e1b8-4ae7-9c24-4bd084729b27 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.584878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 80/165] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:53.585556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.652201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:53.653223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.653705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.654222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] PATH_INFO: `/v3/users/b390b55cc108476686d568ade50a7cec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.655612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] RBAC: Authorizing `identity:get_user(user_id=b390b55cc108476686d568ade50a7cec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:53.660370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:53.661689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:53.663518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 86/166] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/users/b390b55cc108476686d568ade50a7cec => generated 247 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:53.664533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.710628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed84e0-e394-41bc-b8fd-7ef4e0b23625 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.748593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:53.749199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.749488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.749760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.751070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:53.753367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:53.755518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 81/167] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:53.756311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:53.758920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:53.867368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda3c8e-2334-4073-ba4b-7ed6de629429 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.905334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:53.905958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:53.906239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:53.906512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:53.912280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:53.913574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c35ef7-6fef-4ed8-a0c4-4117a225448e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:53.987639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:53.989913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:54.006801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:54.007675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.008159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.008576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.009466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=06f394ef75aa4bb29baa1d6359d2a84f) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:54.009918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:54.011555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:54.022145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 87/168] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/role_assignments?user.id=06f394ef75aa4bb29baa1d6359d2a84f&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=f0d96f0a9747490886f58f738e516776 => generated 608 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:54.023201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.106868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 82/169] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:54.107900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.172342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:54.223517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17faf847-5d4e-4f47-9235-b0ab94f455e4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:54.235371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c962d21f-049d-462d-b266-2245d1a2dbfe None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:54.240403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:54.262807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267b1b45-dce0-4501-93cf-306225d456f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:54.263758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1b45-dce0-4501-93cf-306225d456f4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.264250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1b45-dce0-4501-93cf-306225d456f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.264761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b1b45-dce0-4501-93cf-306225d456f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.294791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:54.297065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.297724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.298377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.326141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:54.332863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:54.334031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:54.334923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:54.339009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 83/170] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:54.341427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.386424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b1b45-dce0-4501-93cf-306225d456f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:54.389506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267b1b45-dce0-4501-93cf-306225d456f4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:54.526569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:54.534540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968fddcc-0a19-4228-ab37-fcac70462628 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:54.569239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 88/171] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:54.570557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09646ee-7b48-4b16-9acf-9eb56c5427d0 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.570838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09646ee-7b48-4b16-9acf-9eb56c5427d0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.571108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09646ee-7b48-4b16-9acf-9eb56c5427d0 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.572387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 89/172] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:54.573319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09646ee-7b48-4b16-9acf-9eb56c5427d0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.580289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:54.601943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:54.602590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.602868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.603139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.604394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:54.605862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:54.607665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 84/173] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:54.608460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.694590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09646ee-7b48-4b16-9acf-9eb56c5427d0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:54.734738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b9b0b-0c67-423c-8ce0-5cb410e8758b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:54.742246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:54.742861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.743133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.743398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.744517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:54.744823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:54.746285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182672c-0c4c-4a29-b65f-dac89b365400 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:54.759761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 90/174] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:54.759761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.759761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.759761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.779810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:54.781014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:54.786726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f357c17-ef9d-4cac-bbdc-7313a25f3c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:54.787610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f357c17-ef9d-4cac-bbdc-7313a25f3c85 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.788116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f357c17-ef9d-4cac-bbdc-7313a25f3c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.788578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f357c17-ef9d-4cac-bbdc-7313a25f3c85 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.789908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f357c17-ef9d-4cac-bbdc-7313a25f3c85 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:54.792103 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f357c17-ef9d-4cac-bbdc-7313a25f3c85 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:54.794962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 85/175] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:54.796746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9e36-173c-4f7b-86f7-8af8189f5d58 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:54.797482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9e36-173c-4f7b-86f7-8af8189f5d58 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:54.798401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bca9e36-173c-4f7b-86f7-8af8189f5d58 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:54.800237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 86/176] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:54.801429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9e36-173c-4f7b-86f7-8af8189f5d58 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.837380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:54.867274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:54.879727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 91/177] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:54.881321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:54.958712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bca9e36-173c-4f7b-86f7-8af8189f5d58 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.009304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fa4b7a-b78d-4836-ae43-31aa19e77ee8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.032546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.033067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.033342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.033612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.034391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=b390b55cc108476686d568ade50a7cec) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:55.034825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:55.036882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:55.047287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a5b5b-52b7-46ff-930b-eda7b49ea8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.048241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a5b5b-52b7-46ff-930b-eda7b49ea8ff None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.048724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a5b5b-52b7-46ff-930b-eda7b49ea8ff None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.049179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a5b5b-52b7-46ff-930b-eda7b49ea8ff None admin] PATH_INFO: `/v3/users/06f394ef75aa4bb29baa1d6359d2a84f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.050490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a5b5b-52b7-46ff-930b-eda7b49ea8ff None admin] RBAC: Authorizing `identity:get_user(user_id=06f394ef75aa4bb29baa1d6359d2a84f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:55.052450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 87/178] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/role_assignments?user.id=b390b55cc108476686d568ade50a7cec&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:55.052958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a5b5b-52b7-46ff-930b-eda7b49ea8ff None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:55.053330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:55.055043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 92/179] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:54 2022] GET /identity/v3/users/06f394ef75aa4bb29baa1d6359d2a84f => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:55.056396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.056870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.057353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.077731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:55.079329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:55.173885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:55.195697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 93/180] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:55.196606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:55.246531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:55.267060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee46e87-1e17-4b56-b456-9adfd4fb496c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.322453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.323723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.324889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.325589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.326743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] RBAC: Adding query filter params (role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=06f394ef75aa4bb29baa1d6359d2a84f) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:55.327214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:55.329453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:55.336433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 88/181] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:55 2022] GET /identity/v3/role_assignments?user.id=06f394ef75aa4bb29baa1d6359d2a84f&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:55.338088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:55.475308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd541156-7836-4cd7-a74f-92e7032bf330 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.478058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65108e96-b711-4e77-aae5-6a1704b166e2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.542199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ed65ec-61d0-4df0-8ab6-f4228660c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.542643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f8d5d-66b1-40eb-af83-291e3d9c355f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.543385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f8d5d-66b1-40eb-af83-291e3d9c355f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.543766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f8d5d-66b1-40eb-af83-291e3d9c355f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.543899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed65ec-61d0-4df0-8ab6-f4228660c522 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.544357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed65ec-61d0-4df0-8ab6-f4228660c522 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.544468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f8d5d-66b1-40eb-af83-291e3d9c355f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.544861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ed65ec-61d0-4df0-8ab6-f4228660c522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.560005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f8d5d-66b1-40eb-af83-291e3d9c355f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4c8f8d5d-66b1-40eb-af83-291e3d9c355f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:55.564624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:55.565748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:02:55.566783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:55.568566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 89/182] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:55.569655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c0032-658a-47f7-b0b2-6d4a919d1147 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.570025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c0032-658a-47f7-b0b2-6d4a919d1147 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.570389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c0032-658a-47f7-b0b2-6d4a919d1147 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.571730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 90/183] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:55.577469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.577784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.578406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.599419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:55.600785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:55.619248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:55.632603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:55.647097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed65ec-61d0-4df0-8ab6-f4228660c522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:55.648624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ed65ec-61d0-4df0-8ab6-f4228660c522 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:55.686629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 91/184] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:55.687492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:55.762464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 94/185] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:55.763546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41e820-5536-4396-b466-784a624789f2 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.763832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41e820-5536-4396-b466-784a624789f2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.764127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e41e820-5536-4396-b466-784a624789f2 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.769599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 95/186] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:55.769599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41e820-5536-4396-b466-784a624789f2 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:55.804313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db761ffd-3dd8-47b9-b59d-dea9ae0e4475 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.839320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.839868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.840204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.840555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.841232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:55.841539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:55.842951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:55.851329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 92/187] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:55.853396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:55.868592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:55.872389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:55.881044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e41e820-5536-4396-b466-784a624789f2 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:55.920029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c549b0-0e07-4328-83d1-9ba0fbefd903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:55.920675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c549b0-0e07-4328-83d1-9ba0fbefd903 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.920960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c549b0-0e07-4328-83d1-9ba0fbefd903 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.921236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c549b0-0e07-4328-83d1-9ba0fbefd903 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.933008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c549b0-0e07-4328-83d1-9ba0fbefd903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-a1c549b0-0e07-4328-83d1-9ba0fbefd903 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:55.937952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:55.938842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:02:55.939640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 96/188] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:02:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:55.945453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160391d-d968-45ff-a445-22483aec5427 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:55.945747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160391d-d968-45ff-a445-22483aec5427 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:55.946022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b160391d-d968-45ff-a445-22483aec5427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:55.967196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b160391d-d968-45ff-a445-22483aec5427 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:55.969334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b160391d-d968-45ff-a445-22483aec5427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:55.971980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0f052-f70d-458c-a078-5d6aaf1d1e2b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.006053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.006684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.006963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.007240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] PATH_INFO: `/v3/projects/b4a19f0186b441d5993337686c95ce50` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.008405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] RBAC: Authorizing `identity:get_project(project_id=b4a19f0186b441d5993337686c95ce50)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.009848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.011500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 93/189] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:55 2022] GET /identity/v3/projects/b4a19f0186b441d5993337686c95ce50 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:56.012285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.048041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 97/190] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:56.049254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160391d-d968-45ff-a445-22483aec5427 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.093937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.116369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e35d7e-06fb-4821-9019-13e530dfd46a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.132067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.151189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b160391d-d968-45ff-a445-22483aec5427 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.152955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.153586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.153860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.154122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] PATH_INFO: `/v3/users/f7932a25572d49819198a59999ad5def` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.155245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] RBAC: Authorizing `identity:get_user(user_id=f7932a25572d49819198a59999ad5def)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.156715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.158291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 94/191] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/users/f7932a25572d49819198a59999ad5def => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:56.158291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.192664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.193517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.193801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.194074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.194739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:56.195033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.196467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.209683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 98/192] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:56.209683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.266047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bc6a1-f345-4dcf-8819-7fb9adce75b2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.302829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.303450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.303727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.304020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.305146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.306579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.308328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 95/193] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:56.308530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692983b1-30af-46f5-ab6e-9bb053eb7a3b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.312899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.331636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.345042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.345586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.345869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.346142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.346872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=b4a19f0186b441d5993337686c95ce50, user.id=06f394ef75aa4bb29baa1d6359d2a84f) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:56.347178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.349186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.354965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 99/194] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/role_assignments?user.id=06f394ef75aa4bb29baa1d6359d2a84f&scope.project.id=b4a19f0186b441d5993337686c95ce50&role.id=f0d96f0a9747490886f58f738e516776 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:56.355551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.375365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.427643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce914e-e9f4-45f3-b90a-b0752bcf017c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.465567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.466196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.466482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.466751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.477564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79965433-e677-42fc-b12d-e21b2e7f6b85 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.516672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.516672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.516967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.517240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] PATH_INFO: `/v3/users/21c61c9224834da2aeb3bf28aebbba6b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.531501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] RBAC: Authorizing `identity:get_user(user_id=21c61c9224834da2aeb3bf28aebbba6b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.533068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.534763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 100/195] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/users/21c61c9224834da2aeb3bf28aebbba6b => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:56.537934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.546318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.548148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.568654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.610138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.645398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806c7a-1324-4500-8caf-d39d2e9929f8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.655392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 96/196] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:56.656334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.678788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.679390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.679665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.679932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.680605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.682063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.702514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 101/197] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:02:56 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:56.703326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.760744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974a155-bccf-4566-8fe2-3177ecc0158a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.779815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.802416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.803070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.803348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.803617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.815131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4d09-d917-4521-a2a5-203d26245b39 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:56.816058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:56.821187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:56.822114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 97/198] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:56.824933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:56.843095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:56.860776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:56.861337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:56.861597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:56.861860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:56.946900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:56.948579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:56.952886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b4a3e-a5e6-4149-8b8d-09666d919c0a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.002610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.003603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.004235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.004718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.006218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.007805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.009507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 98/199] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:57.010284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.067416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:57.074120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 102/200] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:57.075218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.128426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:57.139217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d60fe4-e6b1-4959-bae2-4df4014fc1e5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.179120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.180029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.180403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.180807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.181576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:57.181978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.183453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.193071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 99/201] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:57.198536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.209881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f651b0-d4d8-497f-8989-ec57d750c72a None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.272162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.272162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.272162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.272162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.272626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] RBAC: Adding query filter params (role.id=a6c19d4f16a64be19e81d828569765ed, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d, user.id=f7932a25572d49819198a59999ad5def) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:57.272708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.281613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.291523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 103/202] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/role_assignments?user.id=f7932a25572d49819198a59999ad5def&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=a6c19d4f16a64be19e81d828569765ed => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:57.292586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.330807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603eaa9-bf92-4281-9385-73aabd115828 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.350394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:57.410307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:57.429287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2e2f9d-43e4-41c1-a288-ea5c502088a0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.446201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.446844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.447139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.447384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.452727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.454194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.455918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 100/203] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:57.462599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.472601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.474218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.474930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.475345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] PATH_INFO: `/v3/users/21c61c9224834da2aeb3bf28aebbba6b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.480986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] RBAC: Authorizing `identity:get_user(user_id=21c61c9224834da2aeb3bf28aebbba6b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.482257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.485396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 104/204] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/users/21c61c9224834da2aeb3bf28aebbba6b => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:57.492205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.631977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a496a-c008-422a-93c2-b7b8383b6650 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.641445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb385861-81fa-47ce-8a4e-f3a74b47cf95 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:57.679107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.679501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:57.680158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.680336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:57.680712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.680864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:57.681160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.681436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:57.682503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=21c61c9224834da2aeb3bf28aebbba6b) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:57.682503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.684159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.691269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 101/205] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/role_assignments?user.id=21c61c9224834da2aeb3bf28aebbba6b&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:57.714847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:57.768884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:57.770837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:57.880252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 105/206] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:02:57.886149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:57.930762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:58.002470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257d8401-8a68-4bdd-98b3-faa66fa26dee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:58.043963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9dd1fc-f911-4577-92d4-6536eaa7a749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:58.044612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd1fc-f911-4577-92d4-6536eaa7a749 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:58.044891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd1fc-f911-4577-92d4-6536eaa7a749 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:58.045164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dd1fc-f911-4577-92d4-6536eaa7a749 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:58.046352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dd1fc-f911-4577-92d4-6536eaa7a749 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:58.047822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9dd1fc-f911-4577-92d4-6536eaa7a749 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:58.049709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 102/207] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:02:57 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:58.056861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:58.119133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:58.166540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218837a7-c2de-47bd-8581-fb43142a16ba None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:58.202895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:58.203733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:58.204180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:58.204618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:58.205498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] RBAC: Adding query filter params (role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=21c61c9224834da2aeb3bf28aebbba6b) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:58.205951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:58.207601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d24904-ff9b-43e2-aba5-7e435d637151 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:58.213917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 106/208] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:02:58 2022] GET /identity/v3/role_assignments?user.id=21c61c9224834da2aeb3bf28aebbba6b&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:58.916255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa25-3302-4d2b-b751-f818dc45d594 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:58.916799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa25-3302-4d2b-b751-f818dc45d594 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:58.917086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6aa25-3302-4d2b-b751-f818dc45d594 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:58.918689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 103/209] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:58.927216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05190-3c1f-4b02-a4d6-336d9af935f6 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:58.929192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:58.929478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:58.929751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:58.932238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05190-3c1f-4b02-a4d6-336d9af935f6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:58.932732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da05190-3c1f-4b02-a4d6-336d9af935f6 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:58.934335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 107/210] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:58.939658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:58.940224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:58.940758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:58.950592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:58.951802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:58.966134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:58.967562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:59.037058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 104/211] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:59.045462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 108/212] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:02:59.317676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:59.328010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:59.354987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:59.381906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:59.423609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa03cfa-fdf9-434a-ac8a-116685dd7116 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:59.438391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfb78c0-c54e-4e45-97d0-da3525e4ea12 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:59.460046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:59.460844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.461126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.461396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.471717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:02:59.477444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:02:59.478317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:02:59.479155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 105/213] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:02:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:02:59.484993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:59.485840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.485955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:59.486359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.486862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.488147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:59.489972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:59.496036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 109/214] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:59.497836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:59.586949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:59.593726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88e1ff-6bb5-4229-9ffe-b9abf1dbdb96 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:59.605932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109a73e-bae9-44ac-9cf1-9436f300b299 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:59.623374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:02:59.631467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:59.632144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.632422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.632688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.633351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:02:59.633651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:59.635020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba366a4-223c-48dd-86bd-7bc47238bc26 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:59.643091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1fcb9-ae10-4864-a4d8-3e2ecedb581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:59.643734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 106/215] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:02:59.644826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067f6e5-c704-46bb-a5cd-39d6d8583ba1 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.645107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067f6e5-c704-46bb-a5cd-39d6d8583ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.645376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d067f6e5-c704-46bb-a5cd-39d6d8583ba1 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.646747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 107/216] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:02:59.648151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1fcb9-ae10-4864-a4d8-3e2ecedb581d None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.648460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1fcb9-ae10-4864-a4d8-3e2ecedb581d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.648738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1fcb9-ae10-4864-a4d8-3e2ecedb581d None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.649409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1fcb9-ae10-4864-a4d8-3e2ecedb581d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:59.650882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1fcb9-ae10-4864-a4d8-3e2ecedb581d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:59.651270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067f6e5-c704-46bb-a5cd-39d6d8583ba1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:59.674257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 110/217] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:02:59 2022] POST /identity/v3/users => generated 297 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:02:59.674257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.674257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.674257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.710443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:02:59.712624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:02:59.781120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d067f6e5-c704-46bb-a5cd-39d6d8583ba1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:59.812955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 111/218] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:02:59.827129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:02:59.828183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:02:59.828464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:02:59.828738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] PATH_INFO: `/v3/users/a68bed93e88648a0b0fd4604751f0d97` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:02:59.848698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] RBAC: Authorizing `identity:get_user(user_id=a68bed93e88648a0b0fd4604751f0d97)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:02:59.850514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:02:59.853995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 108/219] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:02:59 2022] GET /identity/v3/users/a68bed93e88648a0b0fd4604751f0d97 => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:02:59.858457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:02:59.980604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6c166-564d-431d-9a36-fb596e2774f1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:02:59.982873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.023343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e83179-e865-4b14-8151-f314b12a465c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.023990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83179-e865-4b14-8151-f314b12a465c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.024277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83179-e865-4b14-8151-f314b12a465c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.024607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e83179-e865-4b14-8151-f314b12a465c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.102287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83179-e865-4b14-8151-f314b12a465c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:00.103687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e83179-e865-4b14-8151-f314b12a465c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:00.119969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.144823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.220266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 112/220] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:02:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:00.221694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ab96-17df-4470-a735-d9e6e712d90e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.221889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ab96-17df-4470-a735-d9e6e712d90e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.222215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ab96-17df-4470-a735-d9e6e712d90e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.224359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 113/221] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:00.229087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ab96-17df-4470-a735-d9e6e712d90e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.232277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.251496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa91b0-ff8e-4dff-81bc-5e71ed7cf663 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:00.291553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bc76b-5084-4276-83ac-c6934ea72daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.292667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc76b-5084-4276-83ac-c6934ea72daa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.293176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc76b-5084-4276-83ac-c6934ea72daa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.293644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bc76b-5084-4276-83ac-c6934ea72daa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.306216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bc76b-5084-4276-83ac-c6934ea72daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0a9bc76b-5084-4276-83ac-c6934ea72daa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:00.311774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:00.312701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:00.313485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:00.321318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 109/222] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:00.323164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.323650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.324142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.338330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ab96-17df-4470-a735-d9e6e712d90e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:00.344326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:00.345812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:00.380826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.381389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.381672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.382037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.383091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:00.385210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:00.388425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 114/223] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:00.388837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.423672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 110/224] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:00.424959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.435027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.522024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.538199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f87753-6e39-4c98-999a-a7f1017dd2c1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:00.574768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.575767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.576278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.576748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.577672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=a68bed93e88648a0b0fd4604751f0d97) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:00.578307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:00.580014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:00.586590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 111/225] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/role_assignments?user.id=a68bed93e88648a0b0fd4604751f0d97&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=f0d96f0a9747490886f58f738e516776 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:00.593203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f3bc3-a34b-4bde-a2b5-52af6f79b8a0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:00.631460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.632038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.632325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.632598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.633286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:00.633594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:00.635034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:00.644999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 115/226] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:00.651092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.749573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.777072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.786468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac1ba51-86b1-413f-b22f-a655e1f634c8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:00.824194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.825213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.825691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.826203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] PATH_INFO: `/v3/users/21c61c9224834da2aeb3bf28aebbba6b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:00.833238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] RBAC: Authorizing `identity:get_user(user_id=21c61c9224834da2aeb3bf28aebbba6b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:00.837433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:00.840218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 112/227] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/users/21c61c9224834da2aeb3bf28aebbba6b => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:00.845845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:00.939384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc2154-2858-45f2-9376-e4157f17b3b1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:00.971849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:00.987487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:00.988311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:00.988538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:00.988839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.007145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:01.015428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:01.016386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:01.017177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:01.019480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 116/228] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:01.024214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c740acc3-38d6-4b80-a180-abda1b117591 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:01.027740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:01.074468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:01.076477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:01.078210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:01.079272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.080959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:01.083818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:01.085902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 113/229] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:00 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:01.093777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:01.112961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:01.225295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0026bc-e1db-4d13-b875-6cd1af9c832d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:01.251068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702d5c-6219-46fc-9daf-c89886f41a96 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:01.279282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:01.279897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:01.280203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:01.280474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.281138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:01.281433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:01.282828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:01.292146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 117/230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:01.304880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:01.324624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:01.325294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:01.325576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:01.325887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/21c61c9224834da2aeb3bf28aebbba6b/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.330174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdeb1d00f204fd7a599a25ee51c234e, user_id=21c61c9224834da2aeb3bf28aebbba6b, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:01.336864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:01.370431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 114/231] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:01 2022] PUT /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/21c61c9224834da2aeb3bf28aebbba6b/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:01.388356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:01.459239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238892b-fd43-48e3-bc21-ecc78eada910 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:01.500896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:01.501464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:01.501746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:01.502073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] PATH_INFO: `/v3/users/21c61c9224834da2aeb3bf28aebbba6b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.503256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] RBAC: Authorizing `identity:get_user(user_id=21c61c9224834da2aeb3bf28aebbba6b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:01.505281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:01.513043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:01.513209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 118/232] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:01 2022] GET /identity/v3/users/21c61c9224834da2aeb3bf28aebbba6b => generated 283 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:01.624605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:01.664609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9019bb7f-5504-48a0-a077-6b864450e2de None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:01.704018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdcc5a-0230-46c4-b2fd-62c72743ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:01.704663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdcc5a-0230-46c4-b2fd-62c72743ae9a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:01.704942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdcc5a-0230-46c4-b2fd-62c72743ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:01.705220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdcc5a-0230-46c4-b2fd-62c72743ae9a None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.706360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdcc5a-0230-46c4-b2fd-62c72743ae9a None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:01.708473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdcc5a-0230-46c4-b2fd-62c72743ae9a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:01.710282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 115/233] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:01 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:01.715922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:01.867700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b7526-2ac1-4dc3-a5b1-c03529ca4a44 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:01.899147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:01.921370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb8725-142a-4043-bed8-81e0fb7f3be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:01.922079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8725-142a-4043-bed8-81e0fb7f3be9 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:01.922367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8725-142a-4043-bed8-81e0fb7f3be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:01.922650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb8725-142a-4043-bed8-81e0fb7f3be9 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/21c61c9224834da2aeb3bf28aebbba6b/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:01.924966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb8725-142a-4043-bed8-81e0fb7f3be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdeb1d00f204fd7a599a25ee51c234e, user_id=21c61c9224834da2aeb3bf28aebbba6b, role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:01.926983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb8725-142a-4043-bed8-81e0fb7f3be9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:01.957824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:01 2022] PUT /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/21c61c9224834da2aeb3bf28aebbba6b/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:02.073598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87bf55-ad72-4662-b521-bb1aa5728907 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.074305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87bf55-ad72-4662-b521-bb1aa5728907 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.074793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87bf55-ad72-4662-b521-bb1aa5728907 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.076454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 116/235] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:02.082529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6737027-3d23-4097-b5f5-70d99ba512e4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.083005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6737027-3d23-4097-b5f5-70d99ba512e4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.083079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6737027-3d23-4097-b5f5-70d99ba512e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.109542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d6737027-3d23-4097-b5f5-70d99ba512e4 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:02.110823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d6737027-3d23-4097-b5f5-70d99ba512e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:02.202100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 120/236] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:02.300599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbce864-b3be-4f17-809f-92065502a126 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.302066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbce864-b3be-4f17-809f-92065502a126 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.302540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbce864-b3be-4f17-809f-92065502a126 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.304281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 117/237] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:02.309996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0dff4-c891-42b6-9ffc-efaa6c9832bc None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.310283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0dff4-c891-42b6-9ffc-efaa6c9832bc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.310562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d0dff4-c891-42b6-9ffc-efaa6c9832bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.336952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-38d0dff4-c891-42b6-9ffc-efaa6c9832bc None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:02.338183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-38d0dff4-c891-42b6-9ffc-efaa6c9832bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:02.424259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 121/238] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:02.579043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbce864-b3be-4f17-809f-92065502a126 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:02.716387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbce864-b3be-4f17-809f-92065502a126 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:02.761016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd88e21-7d6d-4f00-9384-62df18d1f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:02.762058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88e21-7d6d-4f00-9384-62df18d1f05d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.762560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88e21-7d6d-4f00-9384-62df18d1f05d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.763025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd88e21-7d6d-4f00-9384-62df18d1f05d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.769206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:02.782003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd88e21-7d6d-4f00-9384-62df18d1f05d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-abd88e21-7d6d-4f00-9384-62df18d1f05d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:02.787268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:02.788203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:02.789039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:02.790185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101758-415f-42bf-9496-87764712a653 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.790474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101758-415f-42bf-9496-87764712a653 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.790736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77101758-415f-42bf-9496-87764712a653 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.791471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 118/239] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:02.795818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 122/240] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:02.797263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52503486-0711-4160-a556-3b952e88d504 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:02.797746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52503486-0711-4160-a556-3b952e88d504 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:02.798194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52503486-0711-4160-a556-3b952e88d504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:02.804814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101758-415f-42bf-9496-87764712a653 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:02.819425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-52503486-0711-4160-a556-3b952e88d504 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:02.821221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-52503486-0711-4160-a556-3b952e88d504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:02.884652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:02.899271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 119/241] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:02.900395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52503486-0711-4160-a556-3b952e88d504 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:02.980341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77101758-415f-42bf-9496-87764712a653 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.045109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.045729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.046006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.046277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.046944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:03.047243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.048657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.063405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 123/242] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:03.073106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.077699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52503486-0711-4160-a556-3b952e88d504 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.104687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.123739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.124401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.124675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.124939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.129791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.132584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.141554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 120/243] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:03.155706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.240807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af37c-7504-42f8-ad8d-d059f767a47e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.243232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.272501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd26911-98ab-4a85-bcd1-53a460d324d5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.277374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.278004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.278280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.278549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] PATH_INFO: `/v3/users/ea8d592097a84bfd976f16fe6d11c304` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.293268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8d592097a84bfd976f16fe6d11c304)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.294924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.296937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 124/244] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/users/ea8d592097a84bfd976f16fe6d11c304 => generated 297 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:03.297817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.313602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.314251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.314537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.314805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.315470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.317458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.340608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 121/245] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:03 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:03.341252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.400198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.451655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0f25-8066-45fc-af38-24176f255591 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.463899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c0285-db47-4dad-8226-d0791f2dfb66 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.503046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.503749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.504074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.504348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.531382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.532050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.532329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.532598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.560671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:03.566730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:03.567650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:03.568503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:03.570882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 125/246] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:03.589007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.602443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.603936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.630382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.662279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.732358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 122/247] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:03.737587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c937f7-97fc-4b62-9c09-0ea1f2495b45 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.739669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.782436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.783048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.783325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.784208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.785543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:03.785850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.787702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.799371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 126/248] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:03.805771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.860116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50246e-13e4-4c2c-ab69-06b20550514a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.900707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.901351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.901627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.901900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.903046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.904541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.906598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 123/249] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:03.910875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.913244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:03.932293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01110-5798-46b8-9db0-8d0116ee2325 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:03.932763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:03.978682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec05f11-02ba-4033-866f-f6c7121e829b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:03.979316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05f11-02ba-4033-866f-f6c7121e829b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.979593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05f11-02ba-4033-866f-f6c7121e829b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.979862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec05f11-02ba-4033-866f-f6c7121e829b None admin] PATH_INFO: `/v3/users/a68bed93e88648a0b0fd4604751f0d97` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.981056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05f11-02ba-4033-866f-f6c7121e829b None admin] RBAC: Authorizing `identity:get_user(user_id=a68bed93e88648a0b0fd4604751f0d97)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:03.983213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec05f11-02ba-4033-866f-f6c7121e829b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:03.985754 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 127/250] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/users/a68bed93e88648a0b0fd4604751f0d97 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:03.987417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fd35a-7427-4641-be05-238eca2f87f7 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:03.987702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fd35a-7427-4641-be05-238eca2f87f7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:03.989359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fd35a-7427-4641-be05-238eca2f87f7 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:03.990831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 128/251] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:03.994885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fd35a-7427-4641-be05-238eca2f87f7 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:04.041505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aec57f-3fe2-4063-bf33-637bad4a5234 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:04.092329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:04.093401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.093401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.093578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.094190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] RBAC: Adding query filter params (role.id=a6c19d4f16a64be19e81d828569765ed, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=ea8d592097a84bfd976f16fe6d11c304) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:04.094494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:04.097216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1ba4f-b1ce-4a3f-acbf-bf77eca0d8a6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:04.105728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 124/252] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/role_assignments?user.id=ea8d592097a84bfd976f16fe6d11c304&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=a6c19d4f16a64be19e81d828569765ed => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:04.106973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961c1e-84d1-444e-a53c-a9c92006fd73 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.107459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961c1e-84d1-444e-a53c-a9c92006fd73 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.107650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e961c1e-84d1-444e-a53c-a9c92006fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.135288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6e961c1e-84d1-444e-a53c-a9c92006fd73 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:04.136653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6e961c1e-84d1-444e-a53c-a9c92006fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:04.151798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fd35a-7427-4641-be05-238eca2f87f7 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:04.194505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:04.195562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.196126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.196609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.198833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:04.200698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:04.202897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 129/253] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:03 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:04.209656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:04.217442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 125/254] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:04.243002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:04.343786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452103a-7627-4e0d-836b-83fb5949d7af None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:04.356307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1c70-32d7-4625-b949-8d8889f86a5e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.357158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1c70-32d7-4625-b949-8d8889f86a5e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.357636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ff1c70-32d7-4625-b949-8d8889f86a5e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.359185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 126/255] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:04.365245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.365542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.365822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.396222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:04.397161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:04.397569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:04.398275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.398768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.399228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/a68bed93e88648a0b0fd4604751f0d97/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.405500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdeb1d00f204fd7a599a25ee51c234e, user_id=a68bed93e88648a0b0fd4604751f0d97, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:04.405841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:04.408309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:04.438572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 130/256] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:04 2022] PUT /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/a68bed93e88648a0b0fd4604751f0d97/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:03:04.507200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 127/257] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:04.649256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:04.739702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:04.763487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcad3f-4466-468c-876d-f6d522a45500 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:04.794317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:04.801048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:04.801690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.801969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.802238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.814339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:04.820603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:04.821493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:04.822309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 131/258] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:04.828586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:04.918081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6feadb9-b680-4457-b02e-4846f165d914 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:04.958004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:04.958661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:04.958927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:04.959193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:04.968553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:04.974313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:04.976024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd75ccf-d3e4-40ad-b77b-b8731539c864 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:04.979593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:04.980502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:04.981352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:04.982407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 128/259] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:04.993251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:05.024433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:05.024969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:05.025251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:05.025524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:05.026726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:05.027031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:05.028629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:05.043463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 132/260] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:05.044936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:05.059033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:05.169702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96614c09-1889-46ab-80f6-67f5807c1bd1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:05.226559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:05.227183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:05.227462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:05.227734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:05.228436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:05.228738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:05.230302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:05.248067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 129/261] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:05.250649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:05.269771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57799274-7c8f-4d9d-afca-611b931f9d7d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:05.319733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:05.340714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:05.341367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:05.341642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:05.341908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] PATH_INFO: `/v3/users/21c61c9224834da2aeb3bf28aebbba6b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:05.343074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] RBAC: Authorizing `identity:get_user(user_id=21c61c9224834da2aeb3bf28aebbba6b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:05.344552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:05.346306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 133/262] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:05 2022] GET /identity/v3/users/21c61c9224834da2aeb3bf28aebbba6b => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:05.352717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:05.364048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349681d-7e4d-4e51-a1f5-46bc53832d8b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:05.399328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:05.399984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:05.400282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:05.400556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] PATH_INFO: `/v3/users/21c61c9224834da2aeb3bf28aebbba6b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:05.401770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] RBAC: Authorizing `identity:get_user(user_id=21c61c9224834da2aeb3bf28aebbba6b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:05.403304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:05.404953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 130/263] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:05 2022] GET /identity/v3/users/21c61c9224834da2aeb3bf28aebbba6b => generated 283 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:05.411180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:05.494576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:05.522352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cabeca-da03-4c7a-a739-9fda704d289a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:05.543527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facca969-e868-43c7-9bfc-5fd4da029e66 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:05.557100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:05.557724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:05.558085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:05.558386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:05.568286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:05.612098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:05.612636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:05.613449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:05.613723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:05.664870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:05.666420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:05.734902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:05.736429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:05.852277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:03:05.858272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:05.862683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:05.925705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:05.940494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:03:05.946910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:06.090840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a956274-acfa-4bea-97ff-4f9636efc6cb None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:06.127016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:06.127578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.127854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.128156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.129332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:06.130809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:06.132493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 135/266] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:05 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:06.138213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:06.177927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70debd-d8df-4b0e-8b3d-1c91a4222a15 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:06.179275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:06.240947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e64fd4b-483e-4f7b-b7a3-934f3e3e51b9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:06.277367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:06.278648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.279101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.279514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.280424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=21c61c9224834da2aeb3bf28aebbba6b) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:06.280877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:06.282482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:06.289017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 136/267] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:06 2022] GET /identity/v3/role_assignments?user.id=21c61c9224834da2aeb3bf28aebbba6b&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:06.317328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa33fe-cc4f-490b-919d-312a5891a504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:06.318007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa33fe-cc4f-490b-919d-312a5891a504 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.318287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa33fe-cc4f-490b-919d-312a5891a504 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.318562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa33fe-cc4f-490b-919d-312a5891a504 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.319920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa33fe-cc4f-490b-919d-312a5891a504 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:06.321470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa33fe-cc4f-490b-919d-312a5891a504 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:06.323560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 132/268] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:05 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:06.330032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:06.478617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481ed2-cc52-4484-8cab-0b6babbc3fbf None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:06.480235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:06.533410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:06.533410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.533691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.533822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.535882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] RBAC: Adding query filter params (role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=21c61c9224834da2aeb3bf28aebbba6b) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:06.535882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:06.536945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e491870-b484-47dd-b6ef-c8ca6afd0d00 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:06.543654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 137/269] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:06 2022] GET /identity/v3/role_assignments?user.id=21c61c9224834da2aeb3bf28aebbba6b&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:06.586077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8774cb-dcc7-445f-a638-5ab3db658bc9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.586640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8774cb-dcc7-445f-a638-5ab3db658bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.586640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8774cb-dcc7-445f-a638-5ab3db658bc9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.588306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 133/270] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:06.593966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd272-d35a-4d3c-b8bc-30440b51a603 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.594250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd272-d35a-4d3c-b8bc-30440b51a603 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.594521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fdd272-d35a-4d3c-b8bc-30440b51a603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.619201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e6fdd272-d35a-4d3c-b8bc-30440b51a603 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:06.620443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e6fdd272-d35a-4d3c-b8bc-30440b51a603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:06.716188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 138/271] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:06.746167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8ea4d-fd54-4d36-a230-30daf2db897d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.746444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8ea4d-fd54-4d36-a230-30daf2db897d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.746627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8ea4d-fd54-4d36-a230-30daf2db897d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.748172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 134/272] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:06.753269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:06.754103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:06.754375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:06.775164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:06.776384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:06.856165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 139/273] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:07.049342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8ea4d-fd54-4d36-a230-30daf2db897d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.154636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.159393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8ea4d-fd54-4d36-a230-30daf2db897d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.161354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.188936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.205456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.206869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.207380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.208164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.222092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:07.227249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:07.228181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:07.228956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:07.231343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 135/274] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:07.237645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.278284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109041d3-6c85-4b8f-bf84-184d89ff775e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.326310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.327304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.327808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.328298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.342404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:07.349420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:07.350304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:07.351096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:07.357925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 140/275] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:07.359707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.362261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356de8c-b901-4672-9f8b-b6eb55e90e37 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.399255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.400291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.400792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.401293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.402144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:07.402637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:07.404236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac9f3b0-1174-48f7-b23c-48a8673ca51c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:07.413255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 136/276] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:07.415343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc555-d6cd-49a4-b716-a0e4dd83346e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.415684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc555-d6cd-49a4-b716-a0e4dd83346e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.415975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9dc555-d6cd-49a4-b716-a0e4dd83346e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.417367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 137/277] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:07.420365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc555-d6cd-49a4-b716-a0e4dd83346e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.443309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.468415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.486097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ad888-419d-4a5a-b23c-a83e2eef394b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.520549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.521150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.521423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.521694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.522347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:07.522669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:07.524091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d79218-412c-45f3-92cd-21f97b126cf6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:07.529957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9dc555-d6cd-49a4-b716-a0e4dd83346e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.531855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 141/278] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:07.532994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.533271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.533539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.551227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:07.552430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:07.568095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f96018a-76d9-4b81-af03-c74dee12946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.568725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96018a-76d9-4b81-af03-c74dee12946d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.568998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96018a-76d9-4b81-af03-c74dee12946d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.569270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f96018a-76d9-4b81-af03-c74dee12946d None admin] PATH_INFO: `/v3/users/02b656b0d98a4002abfc3daf219342ef` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.582542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96018a-76d9-4b81-af03-c74dee12946d None admin] RBAC: Authorizing `identity:get_user(user_id=02b656b0d98a4002abfc3daf219342ef)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:07.583926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f96018a-76d9-4b81-af03-c74dee12946d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:07.585566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 138/279] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/users/02b656b0d98a4002abfc3daf219342ef => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:07.586745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ef8f-c7b2-456e-b040-9b8ab06adf89 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.587301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ef8f-c7b2-456e-b040-9b8ab06adf89 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.587301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7ef8f-c7b2-456e-b040-9b8ab06adf89 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.588589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 139/280] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:07.589129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7ef8f-c7b2-456e-b040-9b8ab06adf89 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.619412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 142/281] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:07.620270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.680691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.699618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.705782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7ef8f-c7b2-456e-b040-9b8ab06adf89 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.723500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ad829-561f-47de-b99d-0f8fb048a6ad None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.742671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3396-65a7-4257-955a-574fbc050a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.743566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3396-65a7-4257-955a-574fbc050a85 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.744003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3396-65a7-4257-955a-574fbc050a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.744407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3396-65a7-4257-955a-574fbc050a85 None admin] PATH_INFO: `/v3/users/ea8d592097a84bfd976f16fe6d11c304` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.746253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3396-65a7-4257-955a-574fbc050a85 None admin] RBAC: Authorizing `identity:get_user(user_id=ea8d592097a84bfd976f16fe6d11c304)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:07.747860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ade3396-65a7-4257-955a-574fbc050a85 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:07.750169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 140/282] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/users/ea8d592097a84bfd976f16fe6d11c304 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:07.755568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.755854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.756153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.759202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.759808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.760112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.760385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.761124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, user.id=02b656b0d98a4002abfc3daf219342ef, scope.system=all) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:07.761420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:07.762858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:07.767986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 143/283] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/role_assignments?user.id=02b656b0d98a4002abfc3daf219342ef&scope.system=all&role.id=f0d96f0a9747490886f58f738e516776 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:07.772956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.778831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:07.780681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:07.876558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 141/284] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:07.888689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.906601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59bc16-a02b-4685-af5e-b9b33c7cc793 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:07.944818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:07.945444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:07.945720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:07.945988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:07.947319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:07.949058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:07.950971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 144/285] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:07.956975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:07.970636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:07.994083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:08.023612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98d46ed-3d3b-4ea7-8c01-17fe96a021d9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.059701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.060364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.060732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.061011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.062207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:08.063648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:08.065503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 142/286] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:08.067711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2244-3bd5-4cb3-ad61-6aa19c8e9146 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.071217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:08.104228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.105219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.105629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.105968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/ea8d592097a84bfd976f16fe6d11c304/roles/a6c19d4f16a64be19e81d828569765ed` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.107987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdeb1d00f204fd7a599a25ee51c234e, user_id=ea8d592097a84bfd976f16fe6d11c304, role_id=a6c19d4f16a64be19e81d828569765ed)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:08.109653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:08.130424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 145/287] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:07 2022] PUT /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/users/ea8d592097a84bfd976f16fe6d11c304/roles/a6c19d4f16a64be19e81d828569765ed => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:08.174935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:08.195909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be6af8-1e39-4448-96d3-c6b1155e31ec None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.236429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.237166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.237444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.237858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.238951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:08.240729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:08.263328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:08.267434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:08.272331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 143/288] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:08 2022] POST /identity/v3/users => generated 293 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:03:08.317637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb8e69-ac1c-4d61-a623-e7e06e939afe None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.360072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.360722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.360995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.361315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.373491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:08.379535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:08.382030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:08.384224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 146/289] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:08.391974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:08.498060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9561bb-6475-4116-afa3-439ff425981b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.533255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.533870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.534147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.534474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.535666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:08.535978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:08.537380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:08.545966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 144/290] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:08.552483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:08.675587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a597d04-c65f-4a67-886c-d162b6bdff65 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.704632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:08.712348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.713042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.713328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.713602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] PATH_INFO: `/v3/users/a68bed93e88648a0b0fd4604751f0d97` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.714751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] RBAC: Authorizing `identity:get_user(user_id=a68bed93e88648a0b0fd4604751f0d97)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:08.716313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:08.718462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 147/291] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:08 2022] GET /identity/v3/users/a68bed93e88648a0b0fd4604751f0d97 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:08.724740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:08.792786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:08.835675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521996c4-ee2f-4988-8558-393aa8c2c8c6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:08.871763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:08.872414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:08.872692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:08.872964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:08.945769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:08.947165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:09.009286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:09.050547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 145/292] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:09.056417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:09.184597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb15a0-5484-43f4-880e-3e86b2839231 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:09.230110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e949cd-7b9f-4e0b-91eb-d1f22b8bce6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:09.230755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e949cd-7b9f-4e0b-91eb-d1f22b8bce6c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:09.231041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e949cd-7b9f-4e0b-91eb-d1f22b8bce6c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:09.231313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e949cd-7b9f-4e0b-91eb-d1f22b8bce6c None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:09.236642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e949cd-7b9f-4e0b-91eb-d1f22b8bce6c None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:09.238654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e949cd-7b9f-4e0b-91eb-d1f22b8bce6c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:09.240348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 148/293] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:09 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:09.246471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:09.349651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572b7482-08bc-4e80-acd3-402e87d5190e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:09.389210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:09.389835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:09.390115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:09.390389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:09.391122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=a68bed93e88648a0b0fd4604751f0d97) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:09.391431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:09.392980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f3fb8-c19f-4720-b062-4c770b10a09b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:09.400010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 146/294] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:09 2022] GET /identity/v3/role_assignments?user.id=a68bed93e88648a0b0fd4604751f0d97&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=f0d96f0a9747490886f58f738e516776 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:10.015086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa5a41-6782-4456-b2bb-efc01c8ca2fc None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.015593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa5a41-6782-4456-b2bb-efc01c8ca2fc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.015669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa5a41-6782-4456-b2bb-efc01c8ca2fc None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.017275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 149/295] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:10.024280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b27407-093e-4ad1-ad51-6d79550b5238 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.024762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b27407-093e-4ad1-ad51-6d79550b5238 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.024863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b27407-093e-4ad1-ad51-6d79550b5238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.045560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-96b27407-093e-4ad1-ad51-6d79550b5238 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:10.046756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-96b27407-093e-4ad1-ad51-6d79550b5238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:10.069521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:10.122974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 147/296] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:10.399550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa5a41-6782-4456-b2bb-efc01c8ca2fc None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:10.420230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22790e2-e2f5-4fb3-a618-1250851c5834 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.420882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22790e2-e2f5-4fb3-a618-1250851c5834 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.421356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22790e2-e2f5-4fb3-a618-1250851c5834 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.423232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 148/297] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:10.429291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.429834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.430306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.449409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:10.450945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:10.472939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:10.507895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa5a41-6782-4456-b2bb-efc01c8ca2fc None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:10.524945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 149/298] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:10.545825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5590f76-1ea3-45d3-bc04-e0d2d4af783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:10.546744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590f76-1ea3-45d3-bc04-e0d2d4af783d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.547228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590f76-1ea3-45d3-bc04-e0d2d4af783d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.547670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5590f76-1ea3-45d3-bc04-e0d2d4af783d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.558447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5590f76-1ea3-45d3-bc04-e0d2d4af783d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-b5590f76-1ea3-45d3-bc04-e0d2d4af783d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:10.563457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:10.564342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:10.565107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:10.568547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 150/299] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:10.574581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:10.593944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551844f2-19f9-42cc-83de-6de64f0bac74 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.594234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551844f2-19f9-42cc-83de-6de64f0bac74 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.594489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551844f2-19f9-42cc-83de-6de64f0bac74 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.595969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 151/300] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:10.601719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.602245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.602767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.621739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:10.623409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:10.669567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:10.688828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e8172-f807-4b28-b078-2ac9cde72ab4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:10.712087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 152/301] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:10.730869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:10.731826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.732355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.732823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.733770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:10.734265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:10.735902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:10.750184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 150/302] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:10.751759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:10.808809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:10.830306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:10.853523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47470a-0af4-4562-aedc-5283edcd7075 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:10.888425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523deb7-e83f-4f06-a41d-d91d3098f071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:10.889067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523deb7-e83f-4f06-a41d-d91d3098f071 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.889337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523deb7-e83f-4f06-a41d-d91d3098f071 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.889629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523deb7-e83f-4f06-a41d-d91d3098f071 None admin] PATH_INFO: `/v3/users/02b656b0d98a4002abfc3daf219342ef` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.890726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523deb7-e83f-4f06-a41d-d91d3098f071 None admin] RBAC: Authorizing `identity:get_user(user_id=02b656b0d98a4002abfc3daf219342ef)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:10.892214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523deb7-e83f-4f06-a41d-d91d3098f071 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:10.894286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 153/303] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:10 2022] GET /identity/v3/users/02b656b0d98a4002abfc3daf219342ef => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:10.894286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8202d6-4c63-4aa4-ac35-1f84e19de76e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.894286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8202d6-4c63-4aa4-ac35-1f84e19de76e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.894286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8202d6-4c63-4aa4-ac35-1f84e19de76e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:10.894286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 154/304] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:10.900448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8202d6-4c63-4aa4-ac35-1f84e19de76e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:10.952075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e9533-6933-40e0-85f4-e02d3eccda66 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:10.989526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9ca017-f4cd-44ea-adb9-f1da6d44c97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:10.990165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca017-f4cd-44ea-adb9-f1da6d44c97f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:10.990440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca017-f4cd-44ea-adb9-f1da6d44c97f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:10.990709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9ca017-f4cd-44ea-adb9-f1da6d44c97f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.001277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9ca017-f4cd-44ea-adb9-f1da6d44c97f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0d9ca017-f4cd-44ea-adb9-f1da6d44c97f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:11.007185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:11.008183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:11.008976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 151/305] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:11.009633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.009698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.010121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.015168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8202d6-4c63-4aa4-ac35-1f84e19de76e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.029067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:11.030251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:11.032228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.039248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.050798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.051441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.051717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.052010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] PATH_INFO: `/v3/system/users/02b656b0d98a4002abfc3daf219342ef/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.053374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02b656b0d98a4002abfc3daf219342ef, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.054733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.071274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 155/306] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Aug 31 12:03:10 2022] PUT /identity/v3/system/users/02b656b0d98a4002abfc3daf219342ef/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:03:11.071274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.120298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 152/307] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:11.121187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.186829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545d994-212a-4512-90da-10cbd7c1b751 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.228785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.229353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.229634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.229902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.247168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:11.254549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:11.255396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:11.256215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 156/308] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:11.261211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.271298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ec500-52df-4160-8830-8075f143e039 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.315107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.316567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.317018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.317458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.318310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:11.318822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.320458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.326976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.336061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.336558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 153/309] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:11.337610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.402869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428310d-09ba-4011-a7fc-d652c61e8028 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.436989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.437598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.437878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.438150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.438809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:11.439111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.440555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.441837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe8cac6-3b01-4383-9aca-a1c9c3db5e50 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.449304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 157/310] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:11.450177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.485809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.486357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.486635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.486902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] PATH_INFO: `/v3/users/ea8d592097a84bfd976f16fe6d11c304` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.488258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] RBAC: Authorizing `identity:get_user(user_id=ea8d592097a84bfd976f16fe6d11c304)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.489723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.491459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 154/311] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/users/ea8d592097a84bfd976f16fe6d11c304 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:11.492951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.563073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fad0a-9b1e-4468-8e9a-00f339dd14f2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.566412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.575723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.600570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.601196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.601472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.601737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.602834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.604316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.604560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20fbe3-3725-4bb8-bbe7-f995b560c9bb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.606040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 158/312] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:11.606625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.647111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.647742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.648073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.648326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] PATH_INFO: `/v3/users/3de19cc74b824de596a5d2fd61c97293` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.661344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] RBAC: Authorizing `identity:get_user(user_id=3de19cc74b824de596a5d2fd61c97293)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.662789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.664444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 155/313] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/users/3de19cc74b824de596a5d2fd61c97293 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:11.665182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.722073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2339b2ee-da56-452c-bcbf-5e5ccf169377 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.758077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.759105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.759638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.760184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.765110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51545bd3-70e0-45bb-ab55-59da0df3b808 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.790828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.800970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:11.801577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:11.801852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:11.802120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] PATH_INFO: `/v3/groups` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:11.802746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.804200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.810441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:11.828057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 156/314] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Aug 31 12:03:11 2022] POST /identity/v3/groups => generated 229 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:11.828057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:11.848029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:11.849853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:11.964028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0a1b8-81b8-47de-b1b4-86e423de3c9e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:11.985332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 159/315] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:11.991255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:12.005937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:12.006692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:12.006979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:12.007243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:12.008831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] RBAC: Adding query filter params (role.id=a6c19d4f16a64be19e81d828569765ed, user.id=3de19cc74b824de596a5d2fd61c97293, scope.system=all) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:12.008965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:12.010543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:12.021128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 157/316] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/role_assignments?user.id=3de19cc74b824de596a5d2fd61c97293&scope.system=all&role.id=a6c19d4f16a64be19e81d828569765ed => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:12.091091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:12.119621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae506c-900f-4c37-9a76-e681d53a9f50 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:12.166197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e41ee-cd87-4dd7-8fb2-928ebdc052e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:12.166874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e41ee-cd87-4dd7-8fb2-928ebdc052e9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:12.167561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e41ee-cd87-4dd7-8fb2-928ebdc052e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:12.167561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e41ee-cd87-4dd7-8fb2-928ebdc052e9 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:12.168702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e41ee-cd87-4dd7-8fb2-928ebdc052e9 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:12.170319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e41ee-cd87-4dd7-8fb2-928ebdc052e9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:12.172438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 160/317] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:11 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:12.178765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:12.234240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:12.287701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4c2d8-2895-4c07-b7f3-ad735fc4af7b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:12.322194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:12.323057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:12.323336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:12.323608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:12.324357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] RBAC: Adding query filter params (role.id=a6c19d4f16a64be19e81d828569765ed, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e, user.id=ea8d592097a84bfd976f16fe6d11c304) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:12.324663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:12.326091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df0c56-edfd-4b52-816c-340f72d4231f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:12.333307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 158/318] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:12 2022] GET /identity/v3/role_assignments?user.id=ea8d592097a84bfd976f16fe6d11c304&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=a6c19d4f16a64be19e81d828569765ed => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:13.014617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c18c-454f-4056-880d-1cabb534deb2 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.014929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c18c-454f-4056-880d-1cabb534deb2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.015167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308c18c-454f-4056-880d-1cabb534deb2 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.016707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 161/319] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:13.022362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.022656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.022930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.040833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:13.042023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:13.106187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 159/320] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:13.370998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c18c-454f-4056-880d-1cabb534deb2 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:13.471507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7308c18c-454f-4056-880d-1cabb534deb2 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:13.505827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:13.506456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.506733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.507001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.517708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:13.522623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:13.523474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:13.524303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:13.528583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 162/321] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:13.529593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:13.576218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:13.632360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fb737-7441-410c-8119-f1cb9e1bf9dd None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:13.665978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:13.666584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.666861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.667129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.667790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:13.668123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:13.669491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:13.678269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 160/322] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:13.683737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:13.693195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:13.783614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ecdb7-76e1-4dc1-a2f0-1fdad781c3ad None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:13.817617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d2831-3407-4213-8209-39d854c2e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:13.818248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d2831-3407-4213-8209-39d854c2e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.818527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d2831-3407-4213-8209-39d854c2e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.818798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d2831-3407-4213-8209-39d854c2e5b0 None admin] PATH_INFO: `/v3/users/02b656b0d98a4002abfc3daf219342ef` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.819916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d2831-3407-4213-8209-39d854c2e5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=02b656b0d98a4002abfc3daf219342ef)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:13.821400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d2831-3407-4213-8209-39d854c2e5b0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:13.823402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 163/323] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:13 2022] GET /identity/v3/users/02b656b0d98a4002abfc3daf219342ef => generated 293 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:13.829263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:13.841756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd439-c9b7-48a6-8535-9749bd7d5614 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.842038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd439-c9b7-48a6-8535-9749bd7d5614 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.842307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd439-c9b7-48a6-8535-9749bd7d5614 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.843671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 164/324] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:13.848997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2102f42-48eb-4b18-9f1a-7988daa0f23a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.849272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2102f42-48eb-4b18-9f1a-7988daa0f23a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.849566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2102f42-48eb-4b18-9f1a-7988daa0f23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.868123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f2102f42-48eb-4b18-9f1a-7988daa0f23a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:13.869347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f2102f42-48eb-4b18-9f1a-7988daa0f23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:13.942404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80419a-9c79-43f2-b4ed-ae0d6134c124 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:13.943830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 165/325] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:13.950514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:13.963663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119691d-ad12-4332-8b73-03c3e66dee7d None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.963958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119691d-ad12-4332-8b73-03c3e66dee7d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.964238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119691d-ad12-4332-8b73-03c3e66dee7d None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.965704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 166/326] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:13.970396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.970672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.970939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.978753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:13.981169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:13.981777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:13.982058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:13.982335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:13.983058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] RBAC: Adding query filter params (role.id=f0d96f0a9747490886f58f738e516776, user.id=02b656b0d98a4002abfc3daf219342ef, scope.system=all) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:13.983370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:13.984840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:13.993763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:13.994934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:13.997648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 161/327] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 31 12:03:13 2022] GET /identity/v3/role_assignments?user.id=02b656b0d98a4002abfc3daf219342ef&scope.system=all&role.id=f0d96f0a9747490886f58f738e516776 => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:14.069279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 167/328] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:14.222808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:14.318681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297a1639-92ab-416f-91d6-6f04d8840fa1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:14.341384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:14.351526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:14.352179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:14.352457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:14.352720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:14.353818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:14.355405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:14.357008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 162/329] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:14.362352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:14.392404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:14.439353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4762da3e-5f15-4bcb-8aaf-d939a07ef44a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:14.461384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4503de6d-e68d-437c-8028-32362da3629a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:14.473153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:14.473715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:14.474004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:14.474279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:14.476091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:14.484723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:14.489583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:14.490558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:14.491361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 168/330] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:14.495437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:14.496079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:14.496328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:14.496445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:14.496617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] PATH_INFO: `/v3/groups` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:14.497239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:14.498677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:14.514340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 163/331] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Aug 31 12:03:14 2022] POST /identity/v3/groups => generated 226 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:03:14.605144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7402e52-6935-4226-9c85-a8af2b53b6c0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:14.642182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:14.642786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:14.643064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:14.643333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:14.644070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:14.644372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:14.645764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:14.654680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 169/332] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:14.660437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:14.754593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:14.765386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb19129a-5242-4c01-b78f-fc8850df7aa2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:14.800009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1783f4d-9db2-4cdd-988d-112008ab4b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:14.800650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1783f4d-9db2-4cdd-988d-112008ab4b6d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:14.800923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1783f4d-9db2-4cdd-988d-112008ab4b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:14.801191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1783f4d-9db2-4cdd-988d-112008ab4b6d None admin] PATH_INFO: `/v3/users/3de19cc74b824de596a5d2fd61c97293` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:14.802318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1783f4d-9db2-4cdd-988d-112008ab4b6d None admin] RBAC: Authorizing `identity:get_user(user_id=3de19cc74b824de596a5d2fd61c97293)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:14.803754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1783f4d-9db2-4cdd-988d-112008ab4b6d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:14.805370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 164/333] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:14 2022] GET /identity/v3/users/3de19cc74b824de596a5d2fd61c97293 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:14.811080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:14.869298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:14.920941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b21ce-c542-4f69-b509-ef5f92a5ab97 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:14.963525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd378c-af2a-4e5d-b543-200ae83ed5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:14.966623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd378c-af2a-4e5d-b543-200ae83ed5ff None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:14.966623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd378c-af2a-4e5d-b543-200ae83ed5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:14.966623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd378c-af2a-4e5d-b543-200ae83ed5ff None admin] PATH_INFO: `/v3/system/users/3de19cc74b824de596a5d2fd61c97293/roles/a6c19d4f16a64be19e81d828569765ed` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:14.966623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd378c-af2a-4e5d-b543-200ae83ed5ff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3de19cc74b824de596a5d2fd61c97293, role_id=a6c19d4f16a64be19e81d828569765ed)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:14.967596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd378c-af2a-4e5d-b543-200ae83ed5ff None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:14.979866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 170/334] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Aug 31 12:03:14 2022] PUT /identity/v3/system/users/3de19cc74b824de596a5d2fd61c97293/roles/a6c19d4f16a64be19e81d828569765ed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:03:16.648649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444845ff-853f-4919-82db-2879471af4da None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:16.648649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444845ff-853f-4919-82db-2879471af4da None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:16.648649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444845ff-853f-4919-82db-2879471af4da None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:16.649794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 165/335] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:16.653887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ef57-088d-4b29-b30e-4d08c891fa72 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:16.654695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ef57-088d-4b29-b30e-4d08c891fa72 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:16.655187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c5ef57-088d-4b29-b30e-4d08c891fa72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:16.676961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a1c5ef57-088d-4b29-b30e-4d08c891fa72 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:16.678469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a1c5ef57-088d-4b29-b30e-4d08c891fa72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:16.769827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 171/336] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:17.306575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444845ff-853f-4919-82db-2879471af4da None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:17.315987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433c388-65b1-4384-b259-434298c8429e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.316289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433c388-65b1-4384-b259-434298c8429e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.316542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433c388-65b1-4384-b259-434298c8429e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.318209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 172/337] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:17.323675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24c00-2e91-4ee1-ac74-7bf64118e328 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.323966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24c00-2e91-4ee1-ac74-7bf64118e328 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.324246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d24c00-2e91-4ee1-ac74-7bf64118e328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.361008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d0d24c00-2e91-4ee1-ac74-7bf64118e328 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:17.362260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d0d24c00-2e91-4ee1-ac74-7bf64118e328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:17.439538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444845ff-853f-4919-82db-2879471af4da None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:17.469236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:17.484998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 173/338] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:17.486701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fe84-4c6b-4f06-8c02-304595765d70 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.487395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fe84-4c6b-4f06-8c02-304595765d70 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.488484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e6fe84-4c6b-4f06-8c02-304595765d70 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.490179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27e592-b7ed-4215-a062-838df566f245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:17.490596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 174/339] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:17.490765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e592-b7ed-4215-a062-838df566f245 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.491568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e592-b7ed-4215-a062-838df566f245 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.491568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27e592-b7ed-4215-a062-838df566f245 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.493023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273e0e-5151-4630-8b83-0070671d9d45 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.493518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273e0e-5151-4630-8b83-0070671d9d45 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.493983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80273e0e-5151-4630-8b83-0070671d9d45 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.495823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 175/340] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:17.497043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.497540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.502010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.524375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27e592-b7ed-4215-a062-838df566f245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-3f27e592-b7ed-4215-a062-838df566f245 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:17.530344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:17.531324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:17.532153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:17.539499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:17.541081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:17.541578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 166/341] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:17.543107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.545748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.546278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.577832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:17.580145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:17.610137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:17.669188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 176/342] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:17.671968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:17.712099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 167/343] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:17.814813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2166b75-c0c1-4161-a0c9-1fbee80458ff None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:17.835360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:17.860638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:17.861253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:17.861580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:17.861856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:17.863048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:17.863349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:17.864760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:17.879472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 177/344] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:17.885423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.022620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.028162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f6b90-a732-4718-b698-0d92ad673836 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.097391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.098469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.098953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.099425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.145652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:18.188266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd414fe5-9593-4c25-add8-496278eed496 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.210492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:18.212115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:18.229933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.230821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.231333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.231840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.243386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:18.249813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:18.250743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:18.251528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:18.254732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 178/345] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:18.255870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.291489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:18.329751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 168/346] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:18.330689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.390193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:18.413195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349355ca-41eb-4b62-befc-29207bf6f32b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.454085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.454716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.454932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd1872-db96-4405-98d9-0061bbbd6508 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.455037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.455247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.469039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:18.478202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:18.479185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:18.480043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 179/347] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:18.481350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.499766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.500556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.500914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.501394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.515665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:18.522711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:18.524787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 169/348] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:18.526705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.607328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:18.620419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e9490-49d9-4dc2-8826-26f40d7accd9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.675696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.676427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652471b6-dc25-4b5e-9fdf-36610dee1732 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.676620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.676620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.676901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.677445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:18.678017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:18.680974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:18.689733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:18.693130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 180/349] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:18.694217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.730826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.732592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.733029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.733698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.735633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:18.737688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:18.741241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 170/350] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:18.742298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.819294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a3bd0-eb87-42f5-b4ff-a2264a9bc2fa None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.860288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.860899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.861180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.861462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.862179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:18.862523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:18.863901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:18.872713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb5b1e-cfa7-4829-aa3e-e8a7802d081c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:18.873762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 181/351] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:18.874402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.895863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:18.919782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:18.920451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:18.920732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:18.921003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:18.921668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:18.921971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:18.923758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:18.934543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 171/352] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:18.935398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:18.995611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.001881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce088c9-8edf-4b41-81ad-f281ad708854 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.042143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.042858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.043139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.043408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.064661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446e957-f226-492d-bef0-b48ce5fdfe9a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.105377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b09f30-7476-47ab-bec3-7a6a5d8df15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.106181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b09f30-7476-47ab-bec3-7a6a5d8df15d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.106458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b09f30-7476-47ab-bec3-7a6a5d8df15d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.106730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b09f30-7476-47ab-bec3-7a6a5d8df15d None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.113580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b09f30-7476-47ab-bec3-7a6a5d8df15d None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.115799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b09f30-7476-47ab-bec3-7a6a5d8df15d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.119365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 172/353] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:19.120904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e60cf-3e57-423a-9992-9288577c8c4c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.121194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e60cf-3e57-423a-9992-9288577c8c4c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.121474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972e60cf-3e57-423a-9992-9288577c8c4c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.122704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 173/354] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:19.123726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08f1df-c1fc-4a10-801c-9ac053e67668 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.124030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08f1df-c1fc-4a10-801c-9ac053e67668 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.124309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08f1df-c1fc-4a10-801c-9ac053e67668 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.125641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 174/355] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:19.126217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08f1df-c1fc-4a10-801c-9ac053e67668 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:19.129449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.131114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.150236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.244658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a08f1df-c1fc-4a10-801c-9ac053e67668 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.248366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.253583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 182/356] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:19.254611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:19.288116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e0916-b48d-4967-aa58-a7623f152c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.288736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e0916-b48d-4967-aa58-a7623f152c2e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.289024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e0916-b48d-4967-aa58-a7623f152c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.291442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e0916-b48d-4967-aa58-a7623f152c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.368819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e0916-b48d-4967-aa58-a7623f152c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.370580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e0916-b48d-4967-aa58-a7623f152c2e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.380768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a117c-fc4b-46cd-b2cb-da51b3a2bb9c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.399190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.420824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.421459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.421737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.422005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] PATH_INFO: `/v3/users/3de19cc74b824de596a5d2fd61c97293` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.423141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] RBAC: Authorizing `identity:get_user(user_id=3de19cc74b824de596a5d2fd61c97293)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.425155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.426737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 183/357] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/users/3de19cc74b824de596a5d2fd61c97293 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:19.427496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:19.494603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 175/358] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:19.495933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.496189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.496459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.505055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.516773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:19.518026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:19.542189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7fd6db-d9a8-4ca6-b9c0-edb4e77d51df None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.583216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.583833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.584147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.584428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.585596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:19.585920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.587367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7850f1-677b-47d4-8fb4-e25a5918ff56 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.593050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 184/359] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=f0d96f0a9747490886f58f738e516776 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:19.594225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.594513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.594788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.601227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 176/360] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:19.603301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:19.614235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:19.615493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:19.700377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.708247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 185/361] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:19.709995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:19.753637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdff491f-6845-45a8-8be4-c25b072c8901 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.832475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.833387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.836285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.836710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.838018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.839606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.843282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 177/362] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:19.845851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:19.852304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:19.888046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d95ce-15f7-4df6-a6f4-994776593472 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:19.955862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:19.959977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:19.959977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:19.959977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:19.959977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] RBAC: Adding query filter params (role.id=a6c19d4f16a64be19e81d828569765ed, user.id=3de19cc74b824de596a5d2fd61c97293, scope.system=all) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:19.959977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:19.959977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:19.981341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 186/363] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/role_assignments?user.id=3de19cc74b824de596a5d2fd61c97293&scope.system=all&role.id=a6c19d4f16a64be19e81d828569765ed => generated 510 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:19.982221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.027867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bfc92-0b64-4c92-91bd-2ddda220c7ce None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.069888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.070549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.070831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.071106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.072324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:20.074513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:20.076265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:20.078482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 178/364] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:20.079331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.181390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:20.182663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d5aa7-5048-40da-b1fc-0ac2475024b0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.230152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099532e1-d029-46ae-8d0c-ecdecea931fa None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.232063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.232705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.232983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.233373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.234613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:20.236085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:20.240043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 187/365] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:19 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:20.241384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.281721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.282292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.282740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.283017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.298554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:20.303566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:20.304710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 179/366] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:20.305780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.380808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e4d7e-1506-4634-93da-428c29d827b7 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.383247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:20.426239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.427016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.427300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.427857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.429385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:20.431362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:20.433214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 188/367] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:20.433981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.434256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437f56d-f747-4e6b-bdca-e7619eb3ffdb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.474117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:20.481324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.484039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.484039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.484039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.498241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:20.504273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:20.505141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:20.505945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 180/368] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:20.506594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.567381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae27c-0ef1-4fff-9d92-36b5d660624e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.619089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.619968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.620342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.620622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.621537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:20.621729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:20.623149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:20.629416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 189/369] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:20.630236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.674212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7489416b-6ef0-4d53-9987-fe4f7e1d0218 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.710356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:20.767997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.767997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.767997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.767997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.769365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:20.769365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:20.769365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:20.785396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 181/370] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:20.792052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.819652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea76f7-bd3c-4809-8d74-0ec0a3ea8291 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:20.866493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:20.867125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:20.867409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:20.867683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:20.868484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:20.868768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:20.870290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:20.878044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:20.881899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 190/371] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=f0d96f0a9747490886f58f738e516776 => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:20.883293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:20.936941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acbc06-bf6c-43fe-b0e0-c1c93f8a5433 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:21.017856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:21.018544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.018824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.019096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.019811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:21.024194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:21.025645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:21.026908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:21.032621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bca28-10bd-42a3-b8d4-4225a554327b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:21.041301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 182/372] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:21.048934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:21.071986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:21.073208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.073694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.074188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.155507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:21.157459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:21.225112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdfee6-a8b6-4ee3-a12e-1844c4d09b50 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:21.247787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:21.281797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:21.288620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 191/373] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:21.295694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:21.328772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:21.329325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.329610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.329900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.409957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb4354-c958-4a23-a9bb-a2fa00707e22 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:21.449727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:21.450746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.451286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.451760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.453137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:21.456426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:21.458349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 192/374] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:21 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:21.464324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:21.539440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:21.573170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:21.574495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:21.582362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c64af-c97d-4d99-b6b2-8720d268b470 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:21.620912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:21.621910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.622417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.622894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.624308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:21.626394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:21.629147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 193/375] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:21 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:21.635125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:21.750797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a056fcdb-ec15-4bb6-b27d-a9cdd7c19bbb None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:21.790414 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:21.791407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.791903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.792418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.793338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:21.794004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:21.796094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d455db-ae74-47ec-b704-16c65a235fbc None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:21.799301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:21.804952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 194/376] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:21 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:21.813471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79a4e-1a1d-43f3-bde2-98dfcbd8282a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.814095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79a4e-1a1d-43f3-bde2-98dfcbd8282a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.814618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79a4e-1a1d-43f3-bde2-98dfcbd8282a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.817042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 195/377] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:21.825683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:21.826304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:21.826784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:21.835418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 183/378] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 787 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:21.849095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:21.859456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:21.860690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:21.881768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:21.989337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 196/379] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:22.038676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d596c-7ea9-47cc-95c9-e51d906c8de1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:22.091037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:22.091594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:22.091866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:22.092161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] PATH_INFO: `/v3/projects/b529accab54243219085160b7b1ac0c9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:22.093309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] RBAC: Authorizing `identity:get_project(project_id=b529accab54243219085160b7b1ac0c9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:22.094745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:22.096866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 184/380] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:21 2022] GET /identity/v3/projects/b529accab54243219085160b7b1ac0c9 => generated 344 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:22.102494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:22.236440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e990be-2d96-4863-a9b2-62a86873a50d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:22.275166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:22.280846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:22.281540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:22.281848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:22.282606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] PATH_INFO: `/v3/groups/eb12a90ca0744cc6a5cbf87275d73d9b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:22.290238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] RBAC: Authorizing `identity:get_group(group_id=eb12a90ca0744cc6a5cbf87275d73d9b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:22.292017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:22.294982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 197/381] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:22 2022] GET /identity/v3/groups/eb12a90ca0744cc6a5cbf87275d73d9b => generated 229 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:22.304772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:22.362267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:22.463148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:22.491263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a0c49-29dc-4b79-a395-16d63901a912 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:22.503600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83ee05-d034-4d5f-8aa1-5492cd1570e7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:22.550911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:22.551523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:22.551799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:22.552092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:22.552817 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] RBAC: Adding query filter params (group.id=eb12a90ca0744cc6a5cbf87275d73d9b, role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=b529accab54243219085160b7b1ac0c9) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:22.553126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:22.554550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:22.559031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:22.559661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:22.559940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:22.560233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:22.568418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 185/382] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:22 2022] GET /identity/v3/role_assignments?group.id=eb12a90ca0744cc6a5cbf87275d73d9b&scope.project.id=b529accab54243219085160b7b1ac0c9&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 260 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:22.574479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:22.580054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:22.581018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:22.581820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 198/383] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:22.589051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:22.736219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078221cb-0cb0-4f0a-a26a-4205aea90cda None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:22.787757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:22.788417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:22.788692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:22.788958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:22.789640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:22.789937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:22.791316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:22.807756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 186/384] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:22.814034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:22.887744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:22.937278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0d8bf-2237-461c-9a8d-07b318fbec21 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:22.980845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a58aa5-e5b8-4c41-ac3e-854250ead024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:22.981483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58aa5-e5b8-4c41-ac3e-854250ead024 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:22.981766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58aa5-e5b8-4c41-ac3e-854250ead024 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:22.982039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a58aa5-e5b8-4c41-ac3e-854250ead024 None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:22.983260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58aa5-e5b8-4c41-ac3e-854250ead024 None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:22.984794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a58aa5-e5b8-4c41-ac3e-854250ead024 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:22.986438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 199/385] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:22 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:22.992492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:23.014435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:23.088569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff73e9-bc98-4dde-a64e-ebd6025fb26b None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.088947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff73e9-bc98-4dde-a64e-ebd6025fb26b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.089419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff73e9-bc98-4dde-a64e-ebd6025fb26b None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.091696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 200/386] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:23.097302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c7509-8ab0-4afc-a3a3-1645eba847d9 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.097860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c7509-8ab0-4afc-a3a3-1645eba847d9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.098331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c7509-8ab0-4afc-a3a3-1645eba847d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.124275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-513c7509-8ab0-4afc-a3a3-1645eba847d9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:23.125570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-513c7509-8ab0-4afc-a3a3-1645eba847d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:23.163426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98ae8-f315-4af5-bdea-180fcc9125b6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:23.224017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:23.224659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.224936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.225205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.226467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:23.227903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:23.231771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 187/387] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:22 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:23.236932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:23.248228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 201/388] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:23.365963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:23.378522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e96a-9e8c-4891-8bef-900534748a52 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.378798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e96a-9e8c-4891-8bef-900534748a52 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.379074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c564e96a-9e8c-4891-8bef-900534748a52 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.380681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 202/389] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:23.385703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.385987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.386263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.396812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1b91d-9871-452d-ae69-ab22e3755420 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:23.434661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:23.435930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:23.468532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:23.469198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.469478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.469751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/groups/2dff874667514e0ea153d76014707199/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.474639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] RBAC: Authorizing `identity:create_grant(project_id=7033bee3fb7a4a80a25d41a8098a348d, group_id=2dff874667514e0ea153d76014707199, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:23.476129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:23.492043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 188/390] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 31 12:03:23 2022] PUT /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/groups/2dff874667514e0ea153d76014707199/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:23.522212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:23.534804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:23.548888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 203/391] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:23.646722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0913d8e-1dad-49f6-ba6b-13c5f8d5bed7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:23.683701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:23.684375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.684652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.684919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.688384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:23.699108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:23.704416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:23.705383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:23.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:23.713721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 189/392] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:23.719201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:23.831846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49fbbd-a0fb-45ff-b06e-b24431d3a0ed None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:23.867380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:23.868359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:23.868837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:23.869301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:23.870174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:23.870688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:23.873677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:23.883117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 204/393] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:23.888294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:23.949748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.007508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed35a4e-67f9-4c19-82ab-9d86670bb059 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.042768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.043430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.043756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.044079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.045324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:24.046820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:24.048870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 190/394] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:23 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:24.056666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.100199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:24.138846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:24.185259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1292ec-4cc8-4c97-8120-d7e5c43a77aa None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.214305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a648d3-62d6-49af-84fd-a32d24612d75 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.224434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.225065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.225340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.225605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.237453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:24.243993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:24.245033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:24.245866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:24.248065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 205/395] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:24.251372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.295968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.296643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.296919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.297188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.298405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:24.299885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:24.304538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 191/396] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:24 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:24.311793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.402486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ca2b3-4c3a-47b2-ae64-b387c065b535 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.412369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:24.438499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.439491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.440090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.440566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.441443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:24.441944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:24.443537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecc5f47-ca6f-4f79-95bb-21b4189cf254 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:24.453428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203add8a-8380-4b09-96d4-e4c8e44713c3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.453955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 206/397] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:24.455369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7166e-60b6-4203-92a4-300a48097593 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.456410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7166e-60b6-4203-92a4-300a48097593 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.456917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c7166e-60b6-4203-92a4-300a48097593 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.462562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 207/398] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:24.463910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.464420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.464895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.483145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:24.484704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:24.491186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:24.497697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.498426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.498695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.498957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/groups/2dff874667514e0ea153d76014707199/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.501632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] RBAC: Authorizing `identity:create_grant(project_id=7033bee3fb7a4a80a25d41a8098a348d, group_id=2dff874667514e0ea153d76014707199, role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:24.502933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:24.523982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 192/399] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 31 12:03:24 2022] PUT /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d/groups/2dff874667514e0ea153d76014707199/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:24.523982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.583220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 208/400] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:24.636641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1e7aca-b3d4-4ba3-ae4d-786ad2248fee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.674581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.675592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.676115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.676610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.679457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:24.680953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:24.685824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 193/401] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:24 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:24.693108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.819997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:24.826232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f99c926-154a-41f1-90d6-4253f1c7be6f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:24.864007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:24.864624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:24.864908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:24.865178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:24.866338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:24.867794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:24.869759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 209/402] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:24 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:24.875259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.949926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:24.990136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:25.039484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715c270c-9a13-493f-a755-7adf16161b6c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.079328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40667d1-69a0-418e-9efd-90f86fdcc3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:25.080322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40667d1-69a0-418e-9efd-90f86fdcc3d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.080825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40667d1-69a0-418e-9efd-90f86fdcc3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.081263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40667d1-69a0-418e-9efd-90f86fdcc3d0 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/groups/2dff874667514e0ea153d76014707199/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.083323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40667d1-69a0-418e-9efd-90f86fdcc3d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdeb1d00f204fd7a599a25ee51c234e, group_id=2dff874667514e0ea153d76014707199, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:25.084993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40667d1-69a0-418e-9efd-90f86fdcc3d0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:25.108281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 194/403] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 31 12:03:24 2022] PUT /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/groups/2dff874667514e0ea153d76014707199/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:25.110251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84d776-2ad0-429d-a9c1-0cf49fcb91da None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.110779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84d776-2ad0-429d-a9c1-0cf49fcb91da None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.111237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84d776-2ad0-429d-a9c1-0cf49fcb91da None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.113687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 195/404] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:25.126735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.127358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.127848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.128317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f996f-d936-49b6-9569-622b14508bbd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.165020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:25.166496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:25.167091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:25.168043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.168662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.169142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.190709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:25.197000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:25.198370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:25.199212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:25.201785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 210/405] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:25.208488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:25.240431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:25.320079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 196/406] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:25.320643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfeb4c-0622-4c80-8cc2-d7be30941e10 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.357153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:25.358135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.358626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.359140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.360042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:25.360558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:25.362793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:25.371710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 211/407] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:25.377646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:25.437389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:25.511378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c9e81a-133f-44a6-bb91-14b3e319d228 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.559677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:25.560768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.561329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.561827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.563170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:25.565356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:25.567506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 197/408] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:25 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:25.573695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:25.613408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:25.700216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:25.718289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef15ad9-52f4-41d3-b0b6-9aba60968f93 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.767896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:25.769105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.769607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.770089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.771146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a07097-760c-4da9-b395-10b775f92a0b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.771714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:25.773635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:25.775643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 212/409] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:25 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:25.781790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:25.790243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:25.814383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:25.815062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:25.815334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:25.815604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:25.841534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:25.847030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:25.847932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:25.849099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 198/410] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:25.853849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:25.940675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef659619-8da2-4beb-9edd-76174b5e67da None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:25.999546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a5893-7cef-44c6-ae0c-c350db436cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.000765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a5893-7cef-44c6-ae0c-c350db436cba None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.002421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a5893-7cef-44c6-ae0c-c350db436cba None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.004013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a5893-7cef-44c6-ae0c-c350db436cba None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/groups/2dff874667514e0ea153d76014707199/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.008352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a5893-7cef-44c6-ae0c-c350db436cba None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdeb1d00f204fd7a599a25ee51c234e, group_id=2dff874667514e0ea153d76014707199, role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:26.010297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a5893-7cef-44c6-ae0c-c350db436cba None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:26.039394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 213/411] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 31 12:03:25 2022] PUT /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e/groups/2dff874667514e0ea153d76014707199/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:26.041501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b897a4-53fa-4eab-a907-e9e3b0559dbf None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.042021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b897a4-53fa-4eab-a907-e9e3b0559dbf None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.042498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b897a4-53fa-4eab-a907-e9e3b0559dbf None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.044258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 214/412] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:26.051118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.051768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.052352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.066100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80718d7b-2f8b-431c-9bac-b8f954dc9c24 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:26.074813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:26.076502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:26.088182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:26.117563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.118206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.118449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.118716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.119464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:26.119803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:26.121280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:26.136242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 199/413] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:26.141645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:26.161733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 215/414] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:26.216852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:26.296451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8dc6ba-9638-4e06-a6c5-6d460f5fa8d3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:26.331734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.332394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.332669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.332935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] PATH_INFO: `/v3/groups/eb12a90ca0744cc6a5cbf87275d73d9b` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.334040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] RBAC: Authorizing `identity:get_group(group_id=eb12a90ca0744cc6a5cbf87275d73d9b)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:26.335481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:26.337428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 200/415] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:26 2022] GET /identity/v3/groups/eb12a90ca0744cc6a5cbf87275d73d9b => generated 229 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:26.342700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:26.457232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8eb9a-672c-45ec-be9f-d3ca30a234dd None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:26.469729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:26.496120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.497228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.497770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.498269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] PATH_INFO: `/v3/projects/b529accab54243219085160b7b1ac0c9` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.499617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] RBAC: Authorizing `identity:get_project(project_id=b529accab54243219085160b7b1ac0c9)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:26.501467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:26.504316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 216/416] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:26 2022] GET /identity/v3/projects/b529accab54243219085160b7b1ac0c9 => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:26.513080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:26.540529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:26.583664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c307b6-7a03-4f14-a902-3e4edee1ca55 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:26.594034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:26.658312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.659047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.659321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.659587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.666186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa283af-4661-4183-8a87-d9987fc55c7d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:26.671982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:26.676584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:26.677489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:26.678297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 201/417] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:26.688924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:26.711738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c973c-e07c-4baa-867c-c0f11bbcc01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.712924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c973c-e07c-4baa-867c-c0f11bbcc01c None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.713529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c973c-e07c-4baa-867c-c0f11bbcc01c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.714077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c973c-e07c-4baa-867c-c0f11bbcc01c None admin] PATH_INFO: `/v3/projects/b529accab54243219085160b7b1ac0c9/groups/eb12a90ca0744cc6a5cbf87275d73d9b/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.716326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c973c-e07c-4baa-867c-c0f11bbcc01c None admin] RBAC: Authorizing `identity:create_grant(project_id=b529accab54243219085160b7b1ac0c9, group_id=eb12a90ca0744cc6a5cbf87275d73d9b, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:26.718185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c973c-e07c-4baa-867c-c0f11bbcc01c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:26.735727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 217/418] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Aug 31 12:03:26 2022] PUT /identity/v3/projects/b529accab54243219085160b7b1ac0c9/groups/eb12a90ca0744cc6a5cbf87275d73d9b/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:26.799436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7519ba-8b74-45c5-b5d9-1d78f849526c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.799821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7519ba-8b74-45c5-b5d9-1d78f849526c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.800022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7519ba-8b74-45c5-b5d9-1d78f849526c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.801791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 218/419] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:26.807662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.807980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.808252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.839895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:26.843287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:26.887823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a6300-a304-40ea-a48d-6ca366dea0b9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:26.943451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:26.944543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:26.945050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:26.945545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:26.946410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:26.946926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:26.948851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:26.961329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 219/421] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:26.961912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 202/421] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:26.966946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:26.969184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.084633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6fa8dc-88e9-4a30-8661-1e497c255081 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:27.136100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:27.137089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.137581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.138063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.231392 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:27.233305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:27.235381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.240524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:27.289426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.413795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4444175b-f5fd-4114-b77a-d56c7cba81f9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:27.424013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 220/422] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:27.432450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:27.460550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:27.461233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.461516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.461792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.473573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:27.479482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:27.480399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:27.481184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 203/423] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:27.487977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:27.570160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ad504-01bc-494e-b8e1-2d1d48513a37 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:27.572848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.584794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.596083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d37c66-4661-47e1-b6c3-da798262013d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:27.614132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a631a48d-5349-4a85-bf3b-06b7d9f1a69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:27.615079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631a48d-5349-4a85-bf3b-06b7d9f1a69c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.615561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631a48d-5349-4a85-bf3b-06b7d9f1a69c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.616098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a631a48d-5349-4a85-bf3b-06b7d9f1a69c None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.617465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631a48d-5349-4a85-bf3b-06b7d9f1a69c None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:27.619125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a631a48d-5349-4a85-bf3b-06b7d9f1a69c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:27.621313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 221/424] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:27 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:27.622714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2381c-8362-42e4-bf26-a92a76e509a4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.623193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2381c-8362-42e4-bf26-a92a76e509a4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.623668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2381c-8362-42e4-bf26-a92a76e509a4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.625095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 222/425] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:27.626175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2381c-8362-42e4-bf26-a92a76e509a4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:27.636449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:27.637109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.637394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.637785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.638711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:27.638949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:27.640736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9049e66-a720-4b11-9d9d-2fcab0a671bb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:27.654849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 204/426] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:27.654849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.654849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.654849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.673405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:27.674671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:27.741170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2381c-8362-42e4-bf26-a92a76e509a4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:27.750081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 205/427] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:27.750994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:27.788867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:27.790050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.790486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.791835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.793150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:27.794742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:27.797341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 223/428] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:27 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:27.808853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:27.845603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.867982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04869f4f-f7d2-4fc1-91f1-050950062e3f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:27.884352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:27.919074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:27.919074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:27.919074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:27.919074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:27.981526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a3741-63c0-4495-be94-62143ecc2f61 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.032430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.034504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.053998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.054610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.054887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.055163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.055887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:28.056221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.057668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.064198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 224/429] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:27 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=f0d96f0a9747490886f58f738e516776 => generated 611 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:28.124935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:28.152496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:28.187145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 206/430] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:28.194165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:28.301184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ecbc-b7cf-43a5-99c7-36130ab00b29 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.302779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:28.344163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21ff82-e02b-4f7f-815a-8c08bc7db45b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.349363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.350229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.350748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.351212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.362496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:28.369354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:28.370290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 31 12:03:28.371081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:28.377247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 225/431] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:28.383081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:28.384776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.385683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.386156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.386702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] PATH_INFO: `/v3/projects/7033bee3fb7a4a80a25d41a8098a348d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.388229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] RBAC: Authorizing `identity:get_project(project_id=7033bee3fb7a4a80a25d41a8098a348d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.390895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.395079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 207/432] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/projects/7033bee3fb7a4a80a25d41a8098a348d => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:28.402739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:28.472348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:28.501886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eef63-1629-4cc3-b37a-507354b65fe0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.513526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db054cc7-f216-41bf-b74d-fc223580bd2e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.540310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.540818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.541096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.541366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.542075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] RBAC: Adding query filter params (name=member) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:28.542379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.543774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.553180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 226/433] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:28.558231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:28.566328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.567415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.567923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.568358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.569634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.571243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.573324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 208/434] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:28.579194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:28.590464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:28.673966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b483f-032c-47b6-9a6b-1c1e18171d81 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.699371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa4b77-fea2-4595-b19f-2ce047990a97 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:28.717857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.718609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.718984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.719250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.722534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:28.743506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:28.744550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.745806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.746179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.748041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=7033bee3fb7a4a80a25d41a8098a348d) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:28.748477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.750049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d006c8-251f-4d9f-b889-e584b8f0482d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.757811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 209/435] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=7033bee3fb7a4a80a25d41a8098a348d&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:28.759158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f24-875b-4ae3-a81a-740e6c1a08ee None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.759435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f24-875b-4ae3-a81a-740e6c1a08ee None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.759706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b5f24-875b-4ae3-a81a-740e6c1a08ee None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.765295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 210/436] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:28.771253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:28.771542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:28.771815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:28.801303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:28.802883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:28.820318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:28.821824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:28.851305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:28.915127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 211/437] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:28.954400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 227/438] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:28.960825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.076515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed26d2aa-e207-4396-83c8-932e001034ce None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.091568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.118492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254592e3-404a-4109-a4c1-c7c4fdb26ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.119780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254592e3-404a-4109-a4c1-c7c4fdb26ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.120417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254592e3-404a-4109-a4c1-c7c4fdb26ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.120945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254592e3-404a-4109-a4c1-c7c4fdb26ca1 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.122659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254592e3-404a-4109-a4c1-c7c4fdb26ca1 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:29.124141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254592e3-404a-4109-a4c1-c7c4fdb26ca1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:29.125943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 212/439] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:28 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:29.132316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.161685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461637-7202-49be-aafd-a10139182ee4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.161685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461637-7202-49be-aafd-a10139182ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.161685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85461637-7202-49be-aafd-a10139182ee4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.162952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 213/440] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:29.169668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.169945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.170220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.189485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:29.190771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:29.256862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee48eb43-82ad-403b-a63c-15ad639fc78b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.272143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 214/441] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:29.272995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.285660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.299421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.300084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.300366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.300639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.301776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:29.303202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:29.304809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 228/442] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:29.310416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.383972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edef96d-9316-4394-9f44-512f9519cdcf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.395802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.419678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93960e6-5c4b-4889-aecd-e7713565fdda None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.420788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.421417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.421694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.422637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.433671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:29.439968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:29.440824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:29.441651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:29.442263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 215/443] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:29.447558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.461487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.462168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.462523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.463123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.463640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=f0d96f0a9747490886f58f738e516776, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:29.463995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:29.465399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:29.479991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 229/444] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=f0d96f0a9747490886f58f738e516776 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:29.545626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.567069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b5d7c4-a8f1-4eba-b6d7-6b8838e6ebfa None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.605417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.606037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.606318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.606591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.607268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:29.607575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:29.609017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:29.611277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.620248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 216/445] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:29.625559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.660632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.663805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9765299-f20b-4575-a473-902fff546bd5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.701730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.702416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.702699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.703825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.716246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:29.721910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:29.722996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:29.724024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:29.724799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 230/446] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:29.730505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.754386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02b72af-41af-4f7d-bfaf-e8ac9686474a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.793471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.794098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.794375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.794654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.854150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fad3f-48a8-46f6-a95d-c3df5e7eddbc None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:29.869672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.873376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:29.874830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:29.887581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:29.888198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:29.888475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:29.888747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:29.889485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:29.889782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:29.891146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:29.899453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 231/447] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:29.904640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:29.905018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:29.976489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 217/448] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:29.982135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:30.004499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78501c-1731-437a-a5a2-fca6c9f50894 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.037253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.038043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.038326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.038599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.076563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a53316-61d6-4b04-b381-a6a82b776152 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.083358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:30.105343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.105854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:30.106886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.111247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.111934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.112234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.112503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] PATH_INFO: `/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.113644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdeb1d00f204fd7a599a25ee51c234e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.115060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.116708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 218/449] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/projects/6bdeb1d00f204fd7a599a25ee51c234e => generated 302 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:30.122393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:30.205426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 232/450] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:03:30.211113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:30.220609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84b8a4-532b-4d35-b3e3-856244f067c1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.253659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.254278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.254552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.254818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] PATH_INFO: `/v3/groups/2dff874667514e0ea153d76014707199` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.255914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] RBAC: Authorizing `identity:get_group(group_id=2dff874667514e0ea153d76014707199)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.257357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.258907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 219/451] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:30 2022] GET /identity/v3/groups/2dff874667514e0ea153d76014707199 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:30.264810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:30.286068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:30.307766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340ce5d9-8cb5-4359-a90a-b06f43f4b35b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.330022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:30.342319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.342934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.343211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.343480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] PATH_INFO: `/v3/projects/b529accab54243219085160b7b1ac0c9` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.344613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] RBAC: Authorizing `identity:get_project(project_id=b529accab54243219085160b7b1ac0c9)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.346086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.347705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 233/452] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:03:30 2022] GET /identity/v3/projects/b529accab54243219085160b7b1ac0c9 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:30.353426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:30.363913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a2b62f-5ab5-4379-95ae-7576beea621b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.397604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.398196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.398521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.398793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.399510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] RBAC: Adding query filter params (group.id=2dff874667514e0ea153d76014707199, role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:30.399831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.401283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.406851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 220/453] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:30 2022] GET /identity/v3/role_assignments?group.id=2dff874667514e0ea153d76014707199&scope.project.id=6bdeb1d00f204fd7a599a25ee51c234e&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:30.453992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ec33-3b7d-4d72-99dd-6e0f851ac662 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.490899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34eb954-2195-4910-bfba-90387ae8ea64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.491453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb954-2195-4910-bfba-90387ae8ea64 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.491735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb954-2195-4910-bfba-90387ae8ea64 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.492034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34eb954-2195-4910-bfba-90387ae8ea64 None admin] PATH_INFO: `/v3/groups/eb12a90ca0744cc6a5cbf87275d73d9b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.493181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eb954-2195-4910-bfba-90387ae8ea64 None admin] RBAC: Authorizing `identity:get_group(group_id=eb12a90ca0744cc6a5cbf87275d73d9b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.494662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34eb954-2195-4910-bfba-90387ae8ea64 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.496311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 234/454] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Aug 31 12:03:30 2022] GET /identity/v3/groups/eb12a90ca0744cc6a5cbf87275d73d9b => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:30.502299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:30.604694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d05fb-3fa8-455b-81d9-8f5401b3235c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:30.632864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:30.637839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:30.638500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:30.638932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:30.639444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:30.642517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] RBAC: Adding query filter params (group.id=eb12a90ca0744cc6a5cbf87275d73d9b, role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=b529accab54243219085160b7b1ac0c9) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:30.642517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:30.642517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6bfc26-f96b-42a4-847e-b33759600cf5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:30.648852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 221/455] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Aug 31 12:03:30 2022] GET /identity/v3/role_assignments?group.id=eb12a90ca0744cc6a5cbf87275d73d9b&scope.project.id=b529accab54243219085160b7b1ac0c9&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:32.917124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b66cd-4933-46a4-b04e-117fc1e81326 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:32.923205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b66cd-4933-46a4-b04e-117fc1e81326 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:32.923744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b66cd-4933-46a4-b04e-117fc1e81326 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:32.925933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 235/456] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:32.931536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461912e1-c84b-45d0-8bf7-7f4e7f1dfe67 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:32.932413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461912e1-c84b-45d0-8bf7-7f4e7f1dfe67 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:32.932888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461912e1-c84b-45d0-8bf7-7f4e7f1dfe67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:32.960228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-461912e1-c84b-45d0-8bf7-7f4e7f1dfe67 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:32.961705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-461912e1-c84b-45d0-8bf7-7f4e7f1dfe67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:33.049933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 222/457] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:33.167386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dec84-f854-4c3d-abf1-bfdb5407015f None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.168030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dec84-f854-4c3d-abf1-bfdb5407015f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.168508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dec84-f854-4c3d-abf1-bfdb5407015f None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.170306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 236/458] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:33.175275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad66da-8554-439f-b6a6-6af7a793b3d9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.175806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad66da-8554-439f-b6a6-6af7a793b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.176316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad66da-8554-439f-b6a6-6af7a793b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.200958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-85ad66da-8554-439f-b6a6-6af7a793b3d9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:33.202143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-85ad66da-8554-439f-b6a6-6af7a793b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:33.286375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 223/459] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:33.295117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909252-9060-4d3a-9516-cd15cffca413 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.295688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909252-9060-4d3a-9516-cd15cffca413 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.296217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56909252-9060-4d3a-9516-cd15cffca413 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.297998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 237/460] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:33.303396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.303678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.303970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.332936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:33.334116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:33.403101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:33.425105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 224/461] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:33.496209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56909252-9060-4d3a-9516-cd15cffca413 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:33.513106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:33.627679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:33.632364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56909252-9060-4d3a-9516-cd15cffca413 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:33.679479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:33.680249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.680588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.680952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.696031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:33.699382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:33.717311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:33.718238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:33.719074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:33.719074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:33.719074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:33.719074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 238/462] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:33.728141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:33.809819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:33.812177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d91c5de-e8cf-4fd1-b0f9-2c076cdc50bf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:33.846441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:33.847069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.847339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.847613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.850592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2970f1a-89e1-4f1a-8ceb-9f9421b91469 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:33.857486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:33.858928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:33.875791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:33.876933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:33.881445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:33.881445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:33.881445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:33.881445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 225/463] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:33.881445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:33.890736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:33.891432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.891707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.892003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.892688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:33.892988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:33.894358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933dbba9-37e8-47a1-a052-fb32f88d0892 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:33.906843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 239/464] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:33.912970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc865e-9bda-4c71-a24b-d1cbf438b0b9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:33.913254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc865e-9bda-4c71-a24b-d1cbf438b0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:33.913526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc865e-9bda-4c71-a24b-d1cbf438b0b9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:33.914743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 240/465] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:33.915417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc865e-9bda-4c71-a24b-d1cbf438b0b9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:33.930843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:33.998844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b38725-665d-4f7e-98ca-e6289a211306 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.028340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc865e-9bda-4c71-a24b-d1cbf438b0b9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.032852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.034001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.034275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.034540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.044898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.046335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.055648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:34.060646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:34.061559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:34.062581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:34.062581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:34.062581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:34.062581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 226/466] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:34.064775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:34.070015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.070622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.070900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.071168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.071805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:34.072482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.073870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ed3be3-317a-479c-9e23-300cca13d9e8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.087098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 241/467] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:34.089223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.089758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.090744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.110699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:34.112783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:34.161408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:34.171174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee742dc-3e26-4e84-a105-b14b1de05170 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.192343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 242/468] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:34.193519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:34.210299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.210859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.211186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.211461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.212131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.213959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.237976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 227/469] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:34 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:34.238812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:34.317166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529acdbd-74d0-4efd-b07b-612bf8611e42 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.343326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:34.367329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.368006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.368287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.368611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.369719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:34.370072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.371534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.386007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 243/470] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:34.392434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:34.418004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4254510-3eb2-46e3-9849-60f1ad7b702b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.496264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.496813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.497090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.497362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.498495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.500236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.522205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d87d3-6814-4980-ab4e-2a36f979745e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.531767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 228/471] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:34 2022] POST /identity/v3/users => generated 248 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:34.554177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:34.563047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:34.569804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852068fb-2508-4da1-890a-74826ca3f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.570740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852068fb-2508-4da1-890a-74826ca3f8a7 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.571194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852068fb-2508-4da1-890a-74826ca3f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.571618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852068fb-2508-4da1-890a-74826ca3f8a7 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.573889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852068fb-2508-4da1-890a-74826ca3f8a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.575792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852068fb-2508-4da1-890a-74826ca3f8a7 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.608901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 244/472] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:34 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:03:34.699318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b3d43-bd0d-4515-9c8f-05f97a57e90e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.740031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.740656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.741002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.741214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.754278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.755764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.768884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7621b-9529-49d9-88d8-13e33ccbabc9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.769187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7621b-9529-49d9-88d8-13e33ccbabc9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.769457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7621b-9529-49d9-88d8-13e33ccbabc9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.770972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 245/473] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:34.772611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:34.773491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:34.774356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:34.774356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:34.774356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:34.777783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 229/474] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:34.779626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.779743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:34.779908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.780232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.804277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:34.805486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:34.845238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:34.856820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:34.908345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 246/475] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:34.919802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f8f33-c874-4494-86bd-50b681405474 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:34.962658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:34.963358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:34.963643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:34.963913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:34.964698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:34.965000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:34.966427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:34.984107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 230/476] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:34.989031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:35.144384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e57f02-2083-4f84-bfea-d19e3d81ec70 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:35.199395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:35.200421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:35.200905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:35.201387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:35.202234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:35.203905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:35.236293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 247/477] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:34 2022] POST /identity/v3/users => generated 249 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:35.332657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:35.477175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564b847-1a96-4fa6-a0f9-e676f56a5efa None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:35.494020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:35.516325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:35.517254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:35.517764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:35.518239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:35.519116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:35.520950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:35.529863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.sql.core [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:03:35.529863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 12:03:35.529863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [parameters: {'id': '4ef4208d120e4e54b670f30c073755fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 12:03:35.529863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81686) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Aug 31 12:03:35.547442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return ref.to_dict() Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:03:35.548449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application yield resource Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise self.value Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application session.commit() Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:03:35.550049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:03:35.551457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:03:35.553611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:03:35.555639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [parameters: {'id': '4ef4208d120e4e54b670f30c073755fa', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:35.557761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 31 12:03:35.559771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:35.563658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 231/478] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 31 12:03:35 2022] POST /identity/v3/roles => generated 144 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:35.569928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:35.595062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:35.681820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fac035-fe1e-4987-8bbf-8f70cb0c7da6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:35.719489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07248ce-78f3-428c-b2d0-39073452ad41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:35.720525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07248ce-78f3-428c-b2d0-39073452ad41 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:35.721056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07248ce-78f3-428c-b2d0-39073452ad41 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:35.721543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07248ce-78f3-428c-b2d0-39073452ad41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:35.732448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07248ce-78f3-428c-b2d0-39073452ad41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-e07248ce-78f3-428c-b2d0-39073452ad41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:35.739228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:35.740151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 31 12:03:35.740993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:35.743715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 248/479] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:35.749773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:35.858893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc42dc-73af-4415-b32e-3e980ad3251e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:35.894916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:35.895893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:35.896423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:35.896895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:35.897760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:35.898333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:35.900053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b7e93-5157-4c1f-84cc-5dc861e7872f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:35.909722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 232/480] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:36.799745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29334-cc2d-49f1-86f6-6c53e67e6a08 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:36.800727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29334-cc2d-49f1-86f6-6c53e67e6a08 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:36.801236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29334-cc2d-49f1-86f6-6c53e67e6a08 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:36.803112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 249/481] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:36.808227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0ab3-813b-4e9c-8b57-7ead6f9a8a53 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:36.809122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0ab3-813b-4e9c-8b57-7ead6f9a8a53 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:36.809704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1d0ab3-813b-4e9c-8b57-7ead6f9a8a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:36.841072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4f1d0ab3-813b-4e9c-8b57-7ead6f9a8a53 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:36.842702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4f1d0ab3-813b-4e9c-8b57-7ead6f9a8a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:36.886683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:36.923432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af835-409b-4a39-aa5e-c223e0919ca4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:36.923432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af835-409b-4a39-aa5e-c223e0919ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:36.923432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af835-409b-4a39-aa5e-c223e0919ca4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:36.924132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 250/482] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:36.928789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95431f5-82ec-4575-aa35-6b41c37c2fe7 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:36.929066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95431f5-82ec-4575-aa35-6b41c37c2fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:36.929339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95431f5-82ec-4575-aa35-6b41c37c2fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:36.937416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 233/483] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:36.960263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e95431f5-82ec-4575-aa35-6b41c37c2fe7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:36.961451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e95431f5-82ec-4575-aa35-6b41c37c2fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:37.070020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 251/484] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:37.146047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5a3a8-35af-45f0-86f6-b1659ec43380 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.146387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5a3a8-35af-45f0-86f6-b1659ec43380 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.146596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a5a3a8-35af-45f0-86f6-b1659ec43380 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.148236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 234/485] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:37.153097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.153388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.153667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.179093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:37.180297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:37.182279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:37.260407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 252/486] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:37.320539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5a3a8-35af-45f0-86f6-b1659ec43380 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.407331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.441741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a5a3a8-35af-45f0-86f6-b1659ec43380 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:37.480007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:37.481433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.481715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.481981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.503325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:37.509392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:37.510272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:37.511067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 235/487] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:37.517511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.565169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b291f-b0c9-4bb3-962d-b1961e5907f1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:37.603352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:37.603973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.604254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.604523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.605598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:37.616822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:37.617843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:37.623777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:37.624831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:37.625646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:37.626458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 253/488] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:37.627497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.683122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154f53d-64fa-4d7a-a710-aaf303360dac None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:37.719326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:37.719933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.720251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.721083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.724242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:37.724242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:37.724428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:37.734455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f726a10-a07f-4d6e-b4b1-5b34f7fdf1e5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:37.739739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 236/489] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:37.741723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.777618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:37.778783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.779402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.779772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.793207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:37.800358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:37.802864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 254/490] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:37.804915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.855847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:37.867780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8acbf-81b2-4602-b4b1-2db3b32ea6d8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:37.886480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:37.904602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:37.905941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.906423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.906955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:37.908234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:37.909070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:37.910924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:37.933775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 237/491] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:37.935676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:37.940990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58820c-9f89-42b4-9a44-45a3bb33b26c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:37.982863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:37.983552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:37.983834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:37.984132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.004188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.006317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:38.027411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:38.028405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:38.029329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:38.029329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:38.029329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:38.031612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 255/492] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:38.033159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.057665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6913778-d5ae-420e-89be-b5159e884c25 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.096894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.097603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.097884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.098152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.098837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:38.099113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.100566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d6902-fcb9-4ca8-8e9e-c14e6c47f39e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.114341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 238/493] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:38.114341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd927b7-2ef9-47c9-8100-32d0c47b865d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.114341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd927b7-2ef9-47c9-8100-32d0c47b865d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.114341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd927b7-2ef9-47c9-8100-32d0c47b865d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.114341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 239/494] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:38.114341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd927b7-2ef9-47c9-8100-32d0c47b865d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.133852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.159261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27775e-8c84-4623-b751-fcb5a28323b8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.170281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.195487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.196148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.196431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.196705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.209135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.210605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:38.225157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:38.226094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:38.226955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:38.226955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:38.226955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:38.226955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 256/495] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:38.227174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.232631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd927b7-2ef9-47c9-8100-32d0c47b865d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.268058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.268668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.268945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.269214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.269857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:38.270156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.271529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9b85e-2973-4466-a3a7-767f6eb2fe8f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.283876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 240/496] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:38.285062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.285345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.285615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.303714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:38.304945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:38.343371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539154ef-a809-48d7-980f-b386532167d4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.380014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 241/497] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:38.380014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.381377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.391901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.393076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.393382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.393659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.409492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.411671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:38.431706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:38.432676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:38.433513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:38.433513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:38.433513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:38.433513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 257/498] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:38.435101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.456995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.489676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a7b6c-e9c2-43d0-ad9e-6314e6871a75 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.539161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.539769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.540068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.540338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.540976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:38.541276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.542666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.556371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 242/499] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:38.562849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ff618-735f-4834-8b03-ba5c3260c3d5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.567977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.599526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.600224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.600511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.600974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.608491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.609947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-9b19a80a-c165-49c2-a01d-8af104b6d63e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:38.622789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:38.623701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 258/500] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:38.625222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50497-82b5-4311-bb4c-abfbeeeca9a5 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.625830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50497-82b5-4311-bb4c-abfbeeeca9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.625830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb50497-82b5-4311-bb4c-abfbeeeca9a5 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.626773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 259/501] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:38.628869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50497-82b5-4311-bb4c-abfbeeeca9a5 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.644048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.685635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a437688-ab9f-43c8-aeed-50c714035b06 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.708656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.719324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.719922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.720223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.720549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.721710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:38.722004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.723366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.734731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb50497-82b5-4311-bb4c-abfbeeeca9a5 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.735090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 243/502] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:38.735891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.769001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.769622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.769902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.770172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] PATH_INFO: `/v3/users/glance` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.777432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.778883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-c8a9962c-53be-42f0-b7ef-b87f40f20cad None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:38.789952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:38.790944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:38.791820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 260/503] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:38.792420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.792420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.793039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.810434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:38.811618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:38.843293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea47bb11-0846-4c64-9e0a-a19f1b54dc97 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:38.869391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.878712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:38.879312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:38.879585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:38.879697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 261/504] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:38.879856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:38.880552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.880675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:38.881048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:38.882430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:38.929033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 244/505] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:38.929876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:38.957355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:38.997256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f1c40-5eeb-4791-950a-cc7fd6f24362 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.034062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.034828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.035105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.035372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.039253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7a3cb-299f-4cb3-ac81-1ef52d2d140d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.045663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:39.051027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:39.051910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:39.052776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 262/506] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:39.054160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.079848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.080507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.080784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.081054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.088278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.089734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:39.103091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:39.104123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 245/507] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:39.105037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.155363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.165376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c247c-5eb2-4136-9818-faa8bea76068 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.188656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.199992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.200596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.200874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.201145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.201868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:39.202161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.203601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.211366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5642317d-da81-48a1-9765-e305b71df5d2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.238916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 263/508] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:39.239739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.248444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.249056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.249338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.249612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.317092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.318552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.341086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603ff7a-0174-4c6b-b427-912e2780963b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.362112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.373789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.374387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.374668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.374937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.375594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:39.375890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.377311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.385114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 264/509] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:39.385904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.417384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 246/510] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:39.418334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.436738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.490900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0767c8c-1fd1-4829-8a4c-a238a7b8e2f0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.516629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c577be-623c-430e-a988-c9cb6c0b14a4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.525010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.525549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.525825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.526095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.526821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:39.527123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.528595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.545940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 265/511] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:39.546777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.551026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.551661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.551937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.552237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.562027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.563528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.565951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:39.578776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:39.580433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:39.581407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:39.581407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:39.581407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:39.581407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 247/512] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:39.581407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.646066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caad82f-4865-4c0d-b496-ad82cebc00a8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.647571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.681091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.681685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.681965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.682236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.682350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09780d-5ecd-4f3b-a373-4a124ca693c9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.716269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.716909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.717192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.717468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.728058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.729531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:39.743351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:39.744287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:39.745118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:39.745118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:39.745118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:39.745118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 248/513] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:39.745821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.749575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.751154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.795572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.847375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c59f4-0fda-4c10-97dc-bb67065e15a2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.850239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 266/514] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:39.851072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.853390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:39.883675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.884329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.884614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.884887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:39.895830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:39.897324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:39.911596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:39.912547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:39.913551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:39.913551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:39.913551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:39.913551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 249/515] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:39.917899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:39.949350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31d77d-7adb-4daa-911a-a92bee0d9c85 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:39.985615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:39.986827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:39.987100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:39.987365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.022943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.026023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab7f1a-a84b-459e-8bba-e60e7a5c7f41 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.054927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.056443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.058219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.058918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.059606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.059881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.060188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.060824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:40.061124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.062464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.074628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 250/516] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:40.075414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.157598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 267/517] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:40.158654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.174395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b7f04-3a38-4c0b-a57a-1f1dfff6c551 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.208307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.209109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.209396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.209666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.210331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:40.210634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.212022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.223753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 251/518] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:40.224561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.245400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.257157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd2d8e-293d-45a4-9710-2f737dc38e85 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.258662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.292341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.292895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.293176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.293448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.303611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.305105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:40.319488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:40.320405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:40.322179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:40.322179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:40.322179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:40.322179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 268/519] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:40.322179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.330992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15420a0-34cf-4076-8540-f9aa7b368a10 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.366335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.366936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.367213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.367489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.368153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:40.368452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.369816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.381553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 252/520] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:40.382397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.418038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f0b5-3a2d-4507-aa6b-c19c5bd90f70 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.451178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.451778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.452103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.452383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.453021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.454452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.463119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.476193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 269/521] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:40 2022] POST /identity/v3/users => generated 247 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:40.476999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.489271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ae2be9-4592-45c0-a613-10bbd4b85d1b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.510390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.527918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.529018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.529519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.530030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.543534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.545683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:40.569192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:40.570182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:40.571833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:40.571833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:40.571833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:40.571833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 253/522] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:40.571833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.628571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d78e3-f3f6-4b63-86a6-2c08939b238b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.671141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.671772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.672076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.672342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.680770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.682236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.686939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d5799d-2176-4825-bbc6-a2ea1702cc1f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:40.693840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:40.694767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 270/523] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:40.695663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.725422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.732206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.732578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.732859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.733126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.733807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:40.734107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.735472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.753734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 254/524] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:40.754735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.766351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:40.802367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488a237-ad23-444b-b5de-f066c3344ae1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.838973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.839597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.839873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.840174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.847328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.848814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:40.861299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:40.862765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:40.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 271/525] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:40.867617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.871719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2fd72-321a-421b-ad33-f8ed5f60775e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.911189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:40.912615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:40.912899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:40.913175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:40.913819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:40.914121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:40.915735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:40.936838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 255/526] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:40.936838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:40.982105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb879f8-c3b0-4a31-ae7a-8d7539f6636c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:40.992692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.013554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.020519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.021132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.021415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.021684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.022441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:41.022747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.024224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.042051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 272/527] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:41.043151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.050677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eaea68-146f-4946-9799-e3a6646fcf94 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.088011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.088638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.089049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.089293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.096345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.097771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:41.111852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:41.112973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 256/528] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:41.113889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.151079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd2871-e922-4267-b114-908ebd3f07ba None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.186977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.188084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.188369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.188803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.190074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:41.190417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.191860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.209585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 273/529] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:41.210382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.228517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0610-cfda-4c70-b720-80347d99e64c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.241449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.264255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.265156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.265421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.268312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.273847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.275284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:41.286752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:41.287788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:41.288901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:41.289850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 257/530] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:41.290558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.329804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345b8f0-75a1-4b3b-b717-5ac7f13e28bb None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.365672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.366422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.366771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.367154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.414653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda16d29-7c2d-4be0-ae20-0a979d369779 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.438089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.440120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.449979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.450900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.451328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.451747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.452859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:41.453411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.456100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.477106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 258/531] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:41.479147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.492584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.516366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.550611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 274/532] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:41.551453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.597946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4ccd9-ff66-4d95-be54-c124df13e1a5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.647765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.648333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.648609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.648875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.649599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=e1da264bfb8e41589f88d2e84528d92d) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:41.649901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.651337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.659241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13fd9b-de58-4378-ae45-1e677b06d25d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.664422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 259/533] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/role_assignments?user.id=e1da264bfb8e41589f88d2e84528d92d&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:41.665773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.702226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.702778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.703155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.703588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.704402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:41.704809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.706782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.720476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 275/534] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:41.721701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.733868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.784908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:41.792562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f6896-79f9-4ba9-8525-88003312d560 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.833151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.834157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.834730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.835198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.836224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=8f9c000fb6194cbe8fe70841753c079c) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:41.836736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.838388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.838602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beb96ba-ac0d-4aa2-b12e-d6f050bec701 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:41.845107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 260/535] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/role_assignments?user.id=8f9c000fb6194cbe8fe70841753c079c&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:41.846247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:41.918712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:41.920132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:41.920623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:41.921093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:41.949303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:41.954324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:41.979153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:41.980213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:41.981035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:41.981035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:41.981035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:41.981035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 276/536] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:41.989390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:42.024351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf459b-354c-4759-be3a-0fe6fe8961c4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:42.062250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:42.063248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.063727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.064231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.065173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=5995bbc9449c472ca4f15fc9dddb2092) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:42.065680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:42.067440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:42.074565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 261/537] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/role_assignments?user.id=5995bbc9449c472ca4f15fc9dddb2092&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:42.088525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:42.146619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d7756-cd02-488b-b76c-8f5335f1cc5b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:42.186523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:42.187064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.187344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.187619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.195877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:42.196267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:42.198146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:42.218107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 277/538] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:42.224560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:42.261393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:42.340173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be88f78-2fae-4566-908c-bf462a842117 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:42.379942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:42.381052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.381540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.382037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.389079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:42.390766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-367a5614-14ff-4339-ab83-734aeb5a472a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:42.402917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:42.403795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:42.404680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:42.406997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 262/539] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:42.413739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:42.521874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193abb-7259-432a-8c19-cf705cd12562 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.522183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de330b91-7583-4e71-a2fc-fb550d031205 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:42.522720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193abb-7259-432a-8c19-cf705cd12562 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.523221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5193abb-7259-432a-8c19-cf705cd12562 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.529173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 263/540] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:42.535607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.536165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.536642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.548172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:42.573393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:42.577004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:42.583027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:42.584188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.584684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.585170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.586476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:42.587035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:42.589386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:42.607218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 278/541] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:42.614990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:42.707655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 264/542] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:42.771034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d33aa-7dd1-4857-894b-02c49e5c4dfc None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:42.807279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:42.807840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:42.808143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:42.808409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:42.809122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=c6463d56a7e24d088f6c7a1a8e99139e) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:42.809425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:42.810849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:42.816813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 279/543] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:42 2022] GET /identity/v3/role_assignments?user.id=c6463d56a7e24d088f6c7a1a8e99139e&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:43.009168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:43.025657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:43.124119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8658b-ec4f-47f9-ba42-eb5ee93aea5e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:43.159300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:43.159977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:43.160232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:43.160509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:43.171034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:43.176449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:43.177323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:43.178136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 265/544] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:43.183505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:43.265419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:43.340770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f896c-851e-4d78-ac41-725922976aab None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:43.387982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:43.388519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:43.388801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:43.389073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:43.389739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:43.390044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:43.391420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:43.403667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 280/545] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:43.409913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:43.502248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:43.528965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b89af2-4931-4219-a13e-37ad4acc3ea3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:43.563573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:43.564755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:43.565036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:43.565309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:43.575824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:43.577357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:43.592986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:43.593926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:43.594755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:43.594755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:43.594755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:43.594755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 266/546] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:43.603941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:43.743647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b59482-857c-494f-9b3a-fb62931f5c9d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:43.754204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:43.793473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:43.794082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:43.794366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:43.794642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:43.795288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:43.795590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:43.797062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cab180-7d7c-4ecf-a10f-ba5c48c49085 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:43.816230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 281/547] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:43.821525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:43.882120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daee600-a45c-4bf4-bb2a-1082501855af None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:43.882436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daee600-a45c-4bf4-bb2a-1082501855af None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:43.882678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daee600-a45c-4bf4-bb2a-1082501855af None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:43.884652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 282/548] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:43.890229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:43.890557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:43.890837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:43.920232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:43.921442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:44.001109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05432a1a-30c4-473d-b3c5-58f6ce6f59cd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.046724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:44.053305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 283/549] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:44.064643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:44.065284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.065604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.065921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.081049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:44.082671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b7e1b50d-d4ab-4b05-a8af-f51fec8950d8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:44.101554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:44.103061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:44.104173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 267/550] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:44.108749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:44.218432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:44.224974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193be7d-d081-4c56-af17-6e93ea91face None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.268629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562ef0-3028-4b4c-b3cf-c3c032f2d2ae None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.268800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:44.268918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562ef0-3028-4b4c-b3cf-c3c032f2d2ae None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.269169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13562ef0-3028-4b4c-b3cf-c3c032f2d2ae None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.269472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.269759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.270033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.270774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:44.271086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:44.271612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 268/551] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:44.272565 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:44.275581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.275861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.276177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.303975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:44.303975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:44.308201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 284/552] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:44.313849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:44.384413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 269/553] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:44.411835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:44.486199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94577a4-00e4-4a99-8594-b98b78f7a5af None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.513487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f357b6-5767-4d9b-8e98-bf573924719c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.530729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:44.546332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:44.547155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.547588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.548042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.552397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:44.553145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.553526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.555114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.575216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:44.580594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:44.581616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:44.582468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:44.583099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 270/554] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:44.591176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:44.601087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:44.659227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:44.660975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:44.782062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 285/555] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 31 12:03:44.783540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:44.808244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a857261-7912-496d-912b-ced53c45eb2b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.850361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:44.850967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.851239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.851508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.852205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:44.852503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:44.853873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:44.862281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 271/556] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:44.863167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:44.864015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:44.905146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:44.915456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ccf12-858b-4450-91e9-b706f3eb502e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.957022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:44.957761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:44.958046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:44.958322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:44.968911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:44.974034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff40e36-262e-4cf8-8e1b-99cc95dbcc93 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:44.975205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:44.976140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:44.976958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:44.982825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 286/557] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:44.982825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.014095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.014830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.015103 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.015581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.028151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.029597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-eb45f443-e92a-48d9-8f9d-29384a4326f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:45.044552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:45.045487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:45.046413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:45.046413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:45.046413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:45.050452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 272/558] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:45.051911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe890-8be3-4390-8456-69aacc501f52 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.052213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe890-8be3-4390-8456-69aacc501f52 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.052480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bbe890-8be3-4390-8456-69aacc501f52 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.053729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 273/559] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:45.054412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe890-8be3-4390-8456-69aacc501f52 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.084635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2b3a34-bf7e-4108-af77-a579b3ba6ff0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.100686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.122643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.123500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.123938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.124310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.135609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.137092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:45.152328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:45.153335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:45.154208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:45.154208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:45.154208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:45.154208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 287/560] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:45.154208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.161406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.174128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bbe890-8be3-4390-8456-69aacc501f52 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.209726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.210324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.210598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.210866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.211578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:45.211879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.213269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a959-4c75-4247-ba49-f67563dff397 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.222237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 274/561] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:45.222237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323e91-01f1-4984-8764-023701778f37 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.222237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323e91-01f1-4984-8764-023701778f37 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.222237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03323e91-01f1-4984-8764-023701778f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.241743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-03323e91-01f1-4984-8764-023701778f37 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:45.243018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-03323e91-01f1-4984-8764-023701778f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:45.269678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b1ca4a-26a6-4d2d-8bc4-fedb96ff4523 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.304540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.305054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.305336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.305623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.306242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:45.306544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.307970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.315779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 275/562] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:45.316648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323e91-01f1-4984-8764-023701778f37 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.329413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 288/563] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:45.331165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.358746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.413446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.434219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03323e91-01f1-4984-8764-023701778f37 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.437140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f506ca-bcf0-465a-93d1-4ff3878ded42 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.470868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.471469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.471745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.472040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.472671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:45.472968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.473509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.474132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.474324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52820037-99aa-4481-b3d2-c300d5ffda06 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.474422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.474674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.484827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.486812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.491342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 276/564] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:45.492626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142410-ec9f-4239-a78d-20a5396d1630 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.492920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142410-ec9f-4239-a78d-20a5396d1630 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.493377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a142410-ec9f-4239-a78d-20a5396d1630 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.494521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 277/565] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:45.495216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142410-ec9f-4239-a78d-20a5396d1630 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:45.506912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:45.507869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:45.508793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:45.508793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:45.508793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:45.509596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 289/566] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:45.510383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.600395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a142410-ec9f-4239-a78d-20a5396d1630 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.603605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.626475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c0ded-4e35-4958-a46b-331764bc78af None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.633197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.633828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.634107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.634379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.641037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.643020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2ed373e0-861a-4e45-a128-a91e64d14bc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:45.654186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:45.655201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:45.656366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 278/567] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:45.656876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.657049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.657272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.663827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.664080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.664848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.665047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.665265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.672901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.674387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.677008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:45.677877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:45.685085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:45.686021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 290/568] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:45.686970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.749869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 279/569] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:45.750706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.788539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9f183b-8ec8-407a-930e-8eb202e60fed None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.824041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.824643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.824915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.825182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.825815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:45.826114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:45.827479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:45.834907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.845281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 291/570] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:45.846103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.862853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd26b5ce-71fd-437a-90a3-13f53f5667f6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.893810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:45.900592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.901645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.901926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.902344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.913444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:45.918340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:45.919277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:45.920191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:45.924295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 280/571] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:45.925142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:45.962074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c131177-1298-4d40-a6c3-578f48772bb2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:45.996777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:45.997380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:45.997660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:45.997936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:45.998653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:45.998957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.000427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.012413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 292/572] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.013201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.038489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee63d2-745e-4b4b-a756-98b35e86158d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.072197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.072797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.073074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.073336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.073458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.074455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:46.074764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.076463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.093928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 281/573] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:03:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.094724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.116722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed8e332-f9d9-4d53-a4c5-b298c198eead None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.144491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.150698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.151326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.151601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.151869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.159857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.161328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:46.174389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:46.175391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 293/574] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:46.176409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.199400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221611-1e4c-4572-ae04-6fde818804a7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.234350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.234952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.235229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.235499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.236191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:46.236493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.237849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.245949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 282/575] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.246776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.278867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f93ea3-d483-478c-a9c2-4714f9234618 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.295550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.311752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.312382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.312658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.312925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.313635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=08996d25b2614149a6bc71437c96b135) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:46.313940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.315350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.332106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 294/576] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/role_assignments?user.id=08996d25b2614149a6bc71437c96b135&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.332106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.349368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125afd6f-16e2-4a7e-9f34-9ce9152da24c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.364170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.389517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.390074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.390351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.390620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.402156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:46.407674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:46.408733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 283/577] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:46.410497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.449812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddeb4d-c59e-4c55-b5aa-00cf6f586305 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.488458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.489378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.489661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.489933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.501549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.503012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:46.517288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:46.518255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:46.519153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:46.519153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:46.519153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:46.519153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 295/578] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:46.519153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.536293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c9648-d4f5-4b91-92ae-a62dfac174c7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.557918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.572833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.573452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.573734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.574038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.574786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:46.575093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.576563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.594377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 284/579] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.595744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.627647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.643104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836837b1-92f5-4b44-afa1-9e91578e0747 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.679973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.680775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.681157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.681533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.693974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.695590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.707602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1ddd5-9fdc-4923-82c9-faec809050ce None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:46.712145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:46.713281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:46.714452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:46.714452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:46.714452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:46.720417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 296/580] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:46.721242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.744711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.745323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.745603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.745873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.746534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:46.746831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.748228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.758013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 285/581] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.758819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.816144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.832156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62376267-ec48-49a5-afcb-3132b2fbc5e5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.859905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:46.866681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.867369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.867714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.868092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.868820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:46.869294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.870819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.872035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eba69-8ea5-4d70-a35c-7009a249048f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:46.887937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 297/582] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:46.887937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:46.913451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836334b5-4072-4892-90b3-f77df451758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:46.914095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836334b5-4072-4892-90b3-f77df451758a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:46.914438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836334b5-4072-4892-90b3-f77df451758a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:46.914709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836334b5-4072-4892-90b3-f77df451758a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:46.930290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836334b5-4072-4892-90b3-f77df451758a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:46.931752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836334b5-4072-4892-90b3-f77df451758a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-836334b5-4072-4892-90b3-f77df451758a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:46.946679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:46.947929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:46.949286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:46.949286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:46.949286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:46.949286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 286/583] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:46.949286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836334b5-4072-4892-90b3-f77df451758a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.000537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c812b-3523-470f-9b4c-7da5cb40231e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.035936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.036915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.037359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.037632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.038295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:47.038596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.039983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.056229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 298/584] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:47.057104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.059896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836334b5-4072-4892-90b3-f77df451758a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.065874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.094927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.095617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.095865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.096168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.107231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.108712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.111701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:47.126261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:47.127642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:47.129132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:47.129132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:47.129132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:47.129132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 287/585] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:47.129132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.167279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f37d53-f702-48bf-a223-59f92ce2eb2e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.203413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.204161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.204466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.204739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.211928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.213445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:47.226047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:47.226972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 299/586] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:47.232756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.241135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4be5fd-dcf7-486c-b285-ae24905792bd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.278010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.278628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.278909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.279181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.279826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:47.280170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.281671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.299702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 288/587] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:47.300849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.302041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.340726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21953d25-18d9-4292-9f49-b6e91c359b97 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.360579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.377109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.377912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.378289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.378650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.387200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.388860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:47.401291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:47.402423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:03:47.403532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:47.409709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eccd9a-82ec-42bc-9a76-a429cbe3abcb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.410621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 300/588] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:47.411451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.449377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.449913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.450193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.450461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.451183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:47.451479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.453412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.465804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 289/589] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:47.466673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.520418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94da1589-be15-4091-bc99-8194ba70274e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.548954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.563276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c385d-a95e-4423-939f-043128054719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.564356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c385d-a95e-4423-939f-043128054719 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.564836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c385d-a95e-4423-939f-043128054719 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.565334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c385d-a95e-4423-939f-043128054719 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.566548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c385d-a95e-4423-939f-043128054719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:47.566935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c385d-a95e-4423-939f-043128054719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.569232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174c385d-a95e-4423-939f-043128054719 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.577380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2695579-94ed-4acb-ac3b-33265dd04e71 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.589686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 301/590] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:47.589686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c385d-a95e-4423-939f-043128054719 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.601900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.621824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.622465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.622746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.623017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.630180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.631622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:47.643399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:47.644530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:47.645790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:47.649189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 290/591] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:47.650036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.702343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c385d-a95e-4423-939f-043128054719 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.739224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.739832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.740142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.740421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.741146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:47.741579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.743030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.754140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8122dd-b93f-4ee8-b39b-98074bc1f7a1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.765823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 302/592] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:47.765823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.796515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.797352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.797635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.797935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.806046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.807676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.813604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:47.821653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:47.822872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 291/593] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:47.828420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:47.864104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:47.880477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf5eac-3035-4fc6-b4de-bc82687478dd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.922134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:47.922869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:47.923186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:47.923461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/e1da264bfb8e41589f88d2e84528d92d/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:47.938589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=e1da264bfb8e41589f88d2e84528d92d, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:47.940633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:47.951497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26897637-6a58-4a11-ad08-8c5f48ef9995 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:47.954278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 303/594] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:47 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/e1da264bfb8e41589f88d2e84528d92d/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:47.964610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.011734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.012701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.013175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.013686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.014600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:48.015113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.016933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.036371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 292/595] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:48.037665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.100965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:48.111528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568351-376a-4859-b707-21ea80ad9944 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.158636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.159274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.159552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.159818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.169220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:48.175357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592c7ab-7b98-4a52-a481-ca1335ff4509 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.176054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.179600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:48.200177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:48.201177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:48.202073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:48.202073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:48.202073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:48.202073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 304/596] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:48.202832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.218434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.219375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.219491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.219718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.220638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:48.220951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.222614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.240325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 293/597] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:48.241423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.320412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f85276f-836e-49ea-be74-225a8782e5f4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.354168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed7becb-e98b-4d9a-8dd2-cbe0403c54ec None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.356216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afe6fb-37f0-412a-8df8-02367c8bd778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.356873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afe6fb-37f0-412a-8df8-02367c8bd778 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.357153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afe6fb-37f0-412a-8df8-02367c8bd778 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.357428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afe6fb-37f0-412a-8df8-02367c8bd778 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/8f9c000fb6194cbe8fe70841753c079c/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.372131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afe6fb-37f0-412a-8df8-02367c8bd778 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=8f9c000fb6194cbe8fe70841753c079c, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.374031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9afe6fb-37f0-412a-8df8-02367c8bd778 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.377987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:48.389361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 305/598] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:48 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/8f9c000fb6194cbe8fe70841753c079c/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:48.390676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ac75-52bc-43f0-89f4-d72abf893c1d None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.391077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ac75-52bc-43f0-89f4-d72abf893c1d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.391424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020ac75-52bc-43f0-89f4-d72abf893c1d None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.393030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 306/599] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:48.393637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020ac75-52bc-43f0-89f4-d72abf893c1d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.411971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.413007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.413658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.414124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.415532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:48.416350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.418306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5bb85-9f87-4383-ad07-8e3ef887a088 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.434514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 294/600] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:48.436968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.437477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.437964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.465588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:48.467444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:48.495993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:48.532752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020ac75-52bc-43f0-89f4-d72abf893c1d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.560985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 295/601] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:48.561764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.584441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.585167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.585555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.585896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.601217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.603742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:48.623527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:48.624696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:48.625806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:48.625806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:48.625806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:48.627316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 307/602] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:48.633300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.685856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2bda0-072b-4c08-8826-0cfb7fdd7edb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.707701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:48.725217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.726045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.726396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.726961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.734489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.736764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:48.748702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:48.749806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:48.750937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:48.753420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 296/603] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:48.763993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.769831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:48.791784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f192f96a-ab5e-4ad0-a56a-27e8078274b8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:48.865124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:48.865782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:48.866071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:48.866402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:48.867056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:48.867360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:48.868841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:48.894181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 308/604] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:48.899463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:48.954250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79dfeb-795c-4455-b8a5-cf620a9aec00 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.001224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.002169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.002691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.003166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.004103 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:49.004628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.006260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.019511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 297/605] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:49.020759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.051462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a7ad2-7aad-46e0-890f-81fde98d1fad None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.065606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:49.095608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:49.104788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.106694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.107206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.107685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.118542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.121329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:49.137901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:49.138831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:49.139738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:49.142935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57fd31e-1520-49e1-aa6c-d414447224d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.144383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 309/606] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:49.145222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.190129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.191836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.192411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.192831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.208033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:49.215001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:49.216169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:49.217231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:49.225392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 298/607] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:49.225392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.260193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb5a6c-d8b9-44c9-8226-199739f7ab24 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.295428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.296103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.296386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.296663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/5995bbc9449c472ca4f15fc9dddb2092/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.311879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=5995bbc9449c472ca4f15fc9dddb2092, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.313365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.331615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 310/608] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:49 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/5995bbc9449c472ca4f15fc9dddb2092/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:49.332905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.370591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:49.384284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0376406c-4098-4a56-ad83-55909ef754e3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.440854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:49.458699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.459335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.459617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.459893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.460687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:49.460996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.462545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.480872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 299/609] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:49.488169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.522856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a328de3-ab9d-4d2f-b0e2-2791c09ce739 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.573337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.574422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.574707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.574982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.576110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:49.576697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.578388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.589710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 311/610] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:49.596175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.599671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38dd9e-631f-49a5-91dd-349edca56837 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.653462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.654140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.654425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.654699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/c6463d56a7e24d088f6c7a1a8e99139e/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.672634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=c6463d56a7e24d088f6c7a1a8e99139e, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.675212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.692238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 300/611] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:49 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/c6463d56a7e24d088f6c7a1a8e99139e/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:49.750328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:49.782890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95519063-e9bb-44b3-8530-b4e91f3d4fee None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:49.835191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:49.835832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:49.836133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:49.836404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:49.853617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:49.855076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-5351c569-75f6-4e00-bbc1-e83692717c93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:49.875813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:49.877420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:49.878333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:49.878333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:49.878333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:49.880291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 312/612] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:49.887411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:49.960665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:50.032874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c124afd-7658-4a0b-9385-4f9c6c733ef5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:50.068363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:50.069316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.069794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.070260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.071116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:50.071613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:50.073457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:50.086322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 301/613] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:50.087982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f66e7-8a72-4062-8b07-691fc3600941 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.087982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f66e7-8a72-4062-8b07-691fc3600941 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.087982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f66e7-8a72-4062-8b07-691fc3600941 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.089464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 313/614] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:50.094697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:50.099553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.099553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.099553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.145098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:50.146264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:50.197278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:50.206503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac133b-6bbb-40c0-96c2-e87c9e6a5e4e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:50.242659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:50.243641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.244152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.244621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.253044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:50.254910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:50.267228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:50.268244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:03:50.269178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:50.271764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 302/615] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:50.276851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:50.300395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 314/616] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:50.391684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cd6ec-5c3a-4d15-a644-00c961afcf09 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:50.427610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:50.428592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.429097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.429564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.430514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:50.431018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:50.432674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:50.451706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 303/617] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 31 12:03:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:50.459254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:50.556493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:50.597686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe25bd-3ad5-43e1-9c46-fc3331b5d03f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:50.647058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:50.647614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.647900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.648198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.665402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:50.666891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-a7416c3d-3287-49c9-9cf3-52a66d33da99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:50.684359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:50.685329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:50.686221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:50.686221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:50.686221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:50.686221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 315/618] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:50.691446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:50.711675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723c9dd-2cac-4f2e-9240-ebad4cefa3e2 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.712021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723c9dd-2cac-4f2e-9240-ebad4cefa3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.712246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6723c9dd-2cac-4f2e-9240-ebad4cefa3e2 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.713838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 316/619] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:50.719460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.720548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.720994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.738044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:50.743780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:50.745487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:50.831047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 317/620] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:50.837965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:50.854998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a958f3-fa4f-443e-94db-09cadc6c1842 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:50.890088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:50.890851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:50.891134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:50.891408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:50.892617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:50.892973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:50.894591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:50.907987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:50.916292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 304/621] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:50.921864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.021060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2962579-828c-4e2a-baa1-c7bc31070f0b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.064976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.102738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89137e2-e6fe-4a3a-ac0a-731c31d9b1cd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.104655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.105303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.105585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.105857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.136894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:51.140962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.141664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.141936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:51.142040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:51.142898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:51.143723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:51.144389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.145656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 318/622] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:51.149371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.150882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.151078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:51.167258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:51.168681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 305/623] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:51.170093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.268113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11731907-b424-4ae7-8d24-c9c46116f011 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.271417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.306448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.307321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.307700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.308100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.319080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:51.321030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37602745-6d9c-4f76-a83e-b2ff0108b337 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:51.324429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:51.325844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:51.327525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 319/624] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:51.328994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.358967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.367129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.368411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.368638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.368896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.372672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:51.373772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.375876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.387712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 306/625] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:51.388827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.458453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fce1-67d0-48a7-9147-58a6c9a314c9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.496349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df8e84-27c2-4589-abad-55854c36e07d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.505538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.507238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.508060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.508339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.509125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:51.509437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.510896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.528896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 320/626] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:51.529802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.540652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.542049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.542548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.543443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.544662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:51.545172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.547543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.562269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.562760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 307/627] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:51.565542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.627760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.645829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a236475-215a-4f34-98f0-e0171b772e6f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.674452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b67ff7-ed3c-483f-be2f-c0857107c0d5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.679624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.680282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.680567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.680836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.692924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.694393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:51.708923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:51.709950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:51.710865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:51.710865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:51.710865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:51.710865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 321/628] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:51.710865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.712345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bc179c-8e85-431d-80bb-0bc0e50bd029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.712974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc179c-8e85-431d-80bb-0bc0e50bd029 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.713251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc179c-8e85-431d-80bb-0bc0e50bd029 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.713521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bc179c-8e85-431d-80bb-0bc0e50bd029 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/08996d25b2614149a6bc71437c96b135/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.729160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc179c-8e85-431d-80bb-0bc0e50bd029 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=08996d25b2614149a6bc71437c96b135, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.730609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bc179c-8e85-431d-80bb-0bc0e50bd029 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.744687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 308/629] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:03:51 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/08996d25b2614149a6bc71437c96b135/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:03:51.745819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a1df-009b-4ad3-a62b-de26e44e145b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.746163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a1df-009b-4ad3-a62b-de26e44e145b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.746443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937a1df-009b-4ad3-a62b-de26e44e145b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.752128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 309/630] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:51.752128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937a1df-009b-4ad3-a62b-de26e44e145b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.821057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.855840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0e07bd-1e48-45e2-bc2b-1d74b611a54b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.880369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937a1df-009b-4ad3-a62b-de26e44e145b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:51.890416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:51.906937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.907981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.908921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.909201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.920274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.921757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.934495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:51.935374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.935853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.936326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.937163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ba31dfb0-a58b-438c-9cd7-3eb61581db2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:51.937455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:51.938370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:51.939757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:51.939757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:51.939757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:51.939757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 322/631] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:51.940301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:51.940675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:51.940858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:51.940968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:51.942504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:51.959734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 310/632] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:51.960917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:51.968788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:51.970005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:52.062159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 323/633] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:52.063487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.072337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df6a6a-a63e-4794-86b5-ad6a96f0281a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.109364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.110874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.111402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.111926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.112856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:52.113367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.114979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092e929-b725-4dd6-b9be-815ecdc1cae5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.128450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 311/634] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:52.130152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd72a-88cb-41ef-8351-eb6ca35a81b4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.130635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd72a-88cb-41ef-8351-eb6ca35a81b4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.131097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cd72a-88cb-41ef-8351-eb6ca35a81b4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.132958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 312/635] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:52.134002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd72a-88cb-41ef-8351-eb6ca35a81b4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.164331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.172338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.195882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5de4a6-9ef6-4bb6-89e0-1acc26c835e7 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.245460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.246018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.246296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.246561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.250729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cd72a-88cb-41ef-8351-eb6ca35a81b4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.256179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.257630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-4b622508-da8e-44f3-88b6-f3e8c57ae24d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:52.272522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:52.273537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:52.274480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:52.277066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 324/636] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:52.278570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.279073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.279538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.295800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.296465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.296789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.297059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.299618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:52.301032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:52.306316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.307771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:52.323853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:52.325291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 313/637] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:52.326247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.378077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 325/638] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:52.378971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.437544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.440311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.462533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19885f3-bd41-4fa7-a7d4-fe860e067755 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.496582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8b2092-0719-46e6-8e35-0f1caa7dfa56 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.506116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.506877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.507158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.507419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.508207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:52.508950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.510790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.534287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 314/639] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:52.535154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.537149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.538451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.539232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.539734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.540777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:52.541343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.543107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.562826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 326/640] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:52.564598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.655751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f36dcf-fce9-4eb0-9bb3-d168f30e08a0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.680336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d81949-9007-4b34-9ba4-258d465984d6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.687755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.694352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.695129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.695409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.696070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.709778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:52.715364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:52.716329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:52.720930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:52.721579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.721579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.721579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.721579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.721843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 315/641] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:52.721843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.723520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.797475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.799008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.830928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd34d3-7377-43db-9ac5-e6a64e838ce4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:52.867116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:52.867721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:52.868029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:52.868290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:52.905398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 327/642] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:52.905398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:52.913707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:52.949028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:52.950476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:52.956383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.018064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219f866-4fa6-4d91-a772-67800fe780d9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.052717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.053372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.053648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.054031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.061909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 316/643] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:53.061909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.068482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:53.074246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:53.075243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:53.076164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 328/644] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:53.077456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.148462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.170778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c1aab-63a9-47aa-bfa0-b33fccd44108 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.173203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.185828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b42aa-4df3-4a0b-9579-9de31338281c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.209860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.210469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.210749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.211022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.211761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:53.212117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.213477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.221843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 317/645] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:53.222459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.230845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.232274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.232780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.233249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.249616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.252453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:53.269843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:53.270798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:53.271855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:53.271855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.271855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:53.271855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 329/646] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:53.272139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.332038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9d53-db9e-4271-a05e-8bf79007a921 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.375324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.376503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.376778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.377046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.384328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b77db-e957-40e0-a90b-f87b00d9165f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.388550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.390006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.404690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:53.406202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:53.407120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:53.408081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:53.408081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.408081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:53.408081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 318/647] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:53.408306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.427902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.428349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.428966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.429247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.429519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.430178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:53.430481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.431880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.445510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 330/648] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:53.445510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.521438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d399224-1c72-4d2a-a4eb-130e65b595b3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.551432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c97517-562e-4272-9890-c870a8195902 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.555978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.556616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.556895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.557165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.568479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.569922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:53.585040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:53.586013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:53.586938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:53.586938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.586938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:53.586938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 319/649] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:53.586938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.590971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.591601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.591880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.592305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.592957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:53.593257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.594654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.613919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 331/650] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:53.614793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.660129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.663552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.696450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eb43f-43f2-48d9-86bd-7e912805c5c0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.732756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af6b6a-157c-4f51-bd42-0aa001167e6d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.732996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.733576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.733858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.734139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.734784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:53.735086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.737021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.748988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 320/651] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:53.749798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.778327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.778955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.779235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.779506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.789348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.790795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:53.805503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:53.806441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:53.812440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:53.812440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:53.812440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:53.812440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 332/652] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:53.812440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.849882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774b5e4-7d22-4f25-a551-d2515f1585bc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.878614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.884676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.885275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.885551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.885816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.886447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:53.886743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.888139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.899082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 321/653] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:53.899842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:53.905502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:53.914260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f617771-3413-48ed-b9a3-a4ee9c391af1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:53.949109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:53.949725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.950001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.950277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.957939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:53.959402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-9ad0f2cb-35cc-4e3a-bf52-f2af0829ae49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:53.971314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:53.972425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:53.973554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:53.976085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 333/654] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:53.977807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4ef8-ffa1-48c1-b478-f4b28b3d0e59 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:53.978100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4ef8-ffa1-48c1-b478-f4b28b3d0e59 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:53.978375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a4ef8-ffa1-48c1-b478-f4b28b3d0e59 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:53.979977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 334/655] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:53.980671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a4ef8-ffa1-48c1-b478-f4b28b3d0e59 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.009489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bcb93-36f1-4f3b-995b-8890712c1bff None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.058326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.058951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.059225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.059491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.068042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.069490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:54.081379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:54.082511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 322/656] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:54.083445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.092885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a4ef8-ffa1-48c1-b478-f4b28b3d0e59 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.125405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.126500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.126779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.127070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.127904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.128088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.129326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.135757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.140875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 335/657] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.142452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.156572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.190172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd130f-332f-41d5-b75c-9fd19ab7f6cb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.224453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.225067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.225347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.225613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.233256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.234685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.241187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca8d65-19c8-4f48-88f4-3b4f5b6b60df None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9a1dc626-23d4-414b-9f0e-579beac9d170 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:54.246615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:54.247672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:54.248660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 323/658] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:54.249261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.249597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.250109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.268493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:54.269690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:54.274698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.275288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.275565 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.275834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.276541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.276846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.278277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.289639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 336/659] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.290579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.336559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 324/660] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:54.337868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.364630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.382551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.396873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7595b-ec47-498a-a218-4a3dd7709808 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.431813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.432448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.432725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.432996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.433711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.434015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.435445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.445427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207bb39-b2e0-4268-8944-ae5eb905cb4b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.452331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 337/661] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.452331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.485828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.486553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.486899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.487236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.495069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.496655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:54.509455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:54.510587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:54.511603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 325/662] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:54.512325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.557543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb04578-21c0-423c-8031-4617e116278c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.588152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.594491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.595637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.595914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.596227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.596956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.597265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.598702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.615763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 338/663] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.616640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.626239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.629315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0089e3-300a-4a69-8176-c6a4a2c67f1d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.663164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.663698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.664000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.664271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.664997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=e1da264bfb8e41589f88d2e84528d92d) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.665299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.666716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.672626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 326/664] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/role_assignments?user.id=e1da264bfb8e41589f88d2e84528d92d&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.673501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.727231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c56329-b980-4423-bfd7-083c4531308a None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.769759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.771035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.771657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.772327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.773884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=8f9c000fb6194cbe8fe70841753c079c) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.774583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.777325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.787174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 339/665] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/role_assignments?user.id=8f9c000fb6194cbe8fe70841753c079c&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.788778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfe12c6-37ed-4c2a-8392-4dc9721bf254 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.797073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.846679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021738c-adba-4146-b39c-450604489f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.847309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021738c-adba-4146-b39c-450604489f13 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.847578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021738c-adba-4146-b39c-450604489f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.847918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021738c-adba-4146-b39c-450604489f13 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:54.848732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021738c-adba-4146-b39c-450604489f13 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:54.849088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021738c-adba-4146-b39c-450604489f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:54.850606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021738c-adba-4146-b39c-450604489f13 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:54.874869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.877040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 327/666] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:54.880215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021738c-adba-4146-b39c-450604489f13 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:54.915889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:54.937285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d919144-038e-484c-ad12-17ff613c4b19 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:54.988880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:54.990528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:54.990814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:54.991739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.003725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:55.009083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:55.010006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:55.010842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 340/667] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:55.011548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.025606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021738c-adba-4146-b39c-450604489f13 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.076803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.077846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.078255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.078625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.133248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062d8897-f71c-4187-8a83-a3015937e03c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.148875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.159558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.161377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.170767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.171461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.171856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.172255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.187290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.242644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.244349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.271633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 328/668] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:55.272816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.367340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 341/669] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:55.367340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.400480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.413024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eacfcf0-3b44-489e-8725-0c13779e28c4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.444510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.461232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.462205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.462914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.463614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.464461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:55.465076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.467189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.471655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dddfe-be50-4e09-a970-cf01b4ab2d85 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.477802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 329/670] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:55.478855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.512849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.513579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.514115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.514257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.525596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.527043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:55.542812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:55.544034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:55.545045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:55.545045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:55.545045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:55.548431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 342/671] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:55.549473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.603364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816001-8680-4892-b7d2-ad8c9dd26e49 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.620482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.658745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.660061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.660498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.661246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.667747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cf45f-42aa-4686-b104-b90ad98433bf None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.675632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.677664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:55.697296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:55.698525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:55.699819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:55.699819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:55.699819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:55.707058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 330/672] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:55.707058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.712567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.713441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.713951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.714436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.729111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.731590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.744195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:55.753979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:55.754934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:55.755820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:55.755820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:55.755820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:55.756720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 343/673] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:55.757419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.824859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de55b5-a70a-4a12-83b0-f85ac139c7fc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.862169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.863190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.863678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.864181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.865088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:55.865688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.867258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.880398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 331/674] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:55.881612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:55.898207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fbdd6-96ef-485c-a2f8-c2244a4e16cb None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:55.921391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:55.945144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:55.945756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:55.946035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:55.946306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:55.947753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:55.948047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:55.949718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:55.968002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 344/675] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:55.968002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.016257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.024718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b38bb-fe26-46cf-8316-bb0bc02ca767 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.061224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.062131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.062457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.062807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.063578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:56.063984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.065607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.078331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 332/676] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:56.080365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.086377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3512e8c1-3d7b-40b1-ae11-ecf0d80842aa None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.122787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.123700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.124172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.124740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.132632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.134599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:56.147092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:56.148049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:56.148951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:56.155897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 345/677] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:56.157595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.192848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93aba6-d070-429e-9281-91eaba2a6a25 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.201089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.231732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.232846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.233308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.233796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.241579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.243344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:56.256373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:56.257494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:56.258545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:56.265299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 333/678] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:56.266456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.268344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a1000-dfa2-485e-b3a5-78f4c00379cd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.287667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.308564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.308798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.308889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.309145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.316867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.318554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:56.332588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:56.333600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:56.334587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 346/679] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:56.335222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.382334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ee73d-e381-47fc-a3ec-c964fe1dfebe None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.418845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.420346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.420782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.421274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.422110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:56.423358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.425085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.439325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 334/680] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:56.440562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.447098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.451396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de19e7e-bba6-4185-8e9c-5c74cb9be931 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.488974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.489786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.490167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.490787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.491422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:56.491826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.493453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.512001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 347/681] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:56.512001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.533430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.557821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c04bba-fbe4-4ed5-b05b-e87bca6b83b5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.594903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.595511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.595788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.596094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.596932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:56.597238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.599161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.618323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 335/682] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:56.619182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.624750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afe26d-c86e-4047-b1be-b94444e497e0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.662388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.663369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.663852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.664409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.665366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=5995bbc9449c472ca4f15fc9dddb2092) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:56.665933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.667670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.680371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 348/683] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/role_assignments?user.id=5995bbc9449c472ca4f15fc9dddb2092&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:56.681801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:56.727307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.728910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107de42-131d-48fc-a74b-d3d4f15dd7f5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.769666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.770687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.771168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.771663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.772670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=c6463d56a7e24d088f6c7a1a8e99139e) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:56.773261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:56.775145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a12ab-aa6d-4499-a910-814f5e239da1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:56.782685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:56.786051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 336/684] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/role_assignments?user.id=c6463d56a7e24d088f6c7a1a8e99139e&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:56.788234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367ae8-f08d-4bf7-aa35-bbc7dfa96a3a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.788822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367ae8-f08d-4bf7-aa35-bbc7dfa96a3a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.789622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367ae8-f08d-4bf7-aa35-bbc7dfa96a3a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.791541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 337/685] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:56.799807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e822-ebda-4506-b1a0-472eee5f9ed5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.800512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e822-ebda-4506-b1a0-472eee5f9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.800889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4e822-ebda-4506-b1a0-472eee5f9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.841363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8be4e822-ebda-4506-b1a0-472eee5f9ed5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:56.842739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8be4e822-ebda-4506-b1a0-472eee5f9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:56.861886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18128d7-5d33-43b8-ab51-0e9a18b3939d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:56.906607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:56.908653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.909376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.909799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.942213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 338/686] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:56.943533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33a79-6e25-4ced-83ab-e7d58add87a0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.943822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33a79-6e25-4ced-83ab-e7d58add87a0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.944164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd33a79-6e25-4ced-83ab-e7d58add87a0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.945714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 339/687] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:03:56.951702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:56.951702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:56.952177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:56.977546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:56.979225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:57.028711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.030414 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.063642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:57.072372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 340/688] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:57.151730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 349/689] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:57.153329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.217958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:57.239903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.271814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176b62e-a45b-4905-b146-ba73b75f8c83 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.333765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.334407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.334684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.334953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.352065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.353757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:57.379846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:57.380916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:57.381825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:57.381825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:57.381825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:57.381825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 341/690] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:57.382581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.400620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc3c10-0fa2-48ef-8325-4898ca8d1718 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.426077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:57.438319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.439448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.439726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.440021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.451330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:03:57.456620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:57.457571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:57.458436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 350/691] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:57.459157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.495735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9f414-1685-4a60-96d2-4fc166975255 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.510620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:57.542223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.543410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.544146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.544627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.558413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.560227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:57.576438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:57.577451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:57.578447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:57.578447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:57.578447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:57.585158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 342/692] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:57.586115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.595679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456fc66-c6d3-4929-8ae1-1022adad9408 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.640104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.644215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.644547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.644828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.645478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:57.645779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.647205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.664004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 351/693] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:57.664004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.708141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6470f0-2490-4a04-b150-242d20dc3174 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.713802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:57.754669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.755544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.755989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.756403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.757689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:57.758162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.760582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.772934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 343/694] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:57.774186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.791362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aed88d-7a19-4756-b378-fd50f15b2d58 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.810658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:57.838436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.839098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.839383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.839656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.840785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:57.841091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.842763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.858662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 352/695] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:57.859890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.904755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ea441-02a1-4e0e-affb-22ca53962969 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.942433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:57.943064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:57.943340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:57.943608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:57.951470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:57.955575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:57.965959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:57.966831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:57.967729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:57.972314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 344/696] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:57.973186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:57.978452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f673-d802-4115-8837-c2ba0a48648e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:57.980383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:58.017836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.018827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.019323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.019795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.030431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.032673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:58.048405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:58.049343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:58.050270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:58.050270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:58.050270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:58.052340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 353/697] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:58.053350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:58.075212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:58.093566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28631743-357f-41a5-af7b-8f0fb093d1db None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.130740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.131350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.131630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.131920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.132691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.134128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.159092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a3ec6-8edd-4ab1-97b7-bb4746b1368f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.161085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 345/698] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:03:57 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:03:58.163247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:58.199089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.200110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.200662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.201137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.202097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:58.202635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.204928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.218657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 354/699] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:58.237094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:58.266018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:58.286845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6dcd5-a397-439e-ad4d-b6977b9475bb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.326426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.326817 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.327096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.327370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.328051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:58.328359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.330387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.340601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:58.347794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 346/700] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:58.353328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:58.438693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a550424a-f213-49f7-a799-9ce63149bce8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.461585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a7231-af1f-4fa0-8876-0198048cbfa9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.482898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.483873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.484384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.484877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.485832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=08996d25b2614149a6bc71437c96b135) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:58.486357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.488067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.495668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 355/701] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:03:58 2022] GET /identity/v3/role_assignments?user.id=08996d25b2614149a6bc71437c96b135&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:58.499045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.500306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.501330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.501849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.514784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.516871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:03:58.532107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:58.533124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:58.535236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 347/702] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:03:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:03:58.539346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:58.630272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:58.658031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c702612-a282-452b-9d1c-bd210c7ce122 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.698619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.699285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.699566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.699835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.700631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:58.700939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.702370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de76589-5dfc-4943-bc52-03fd7848828e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.721609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 356/703] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:03:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:58.727503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:58.801529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:58.842345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd9de9-e4b6-484b-a40e-92ea46126296 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:58.878409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14fe39b-c8e1-4ca0-984b-b96e2037032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:58.879025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe39b-c8e1-4ca0-984b-b96e2037032e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.879574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe39b-c8e1-4ca0-984b-b96e2037032e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.879846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14fe39b-c8e1-4ca0-984b-b96e2037032e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.960955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806204a-fc5d-4559-b8e3-ac5d24d2cf0e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.960955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806204a-fc5d-4559-b8e3-ac5d24d2cf0e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.960955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806204a-fc5d-4559-b8e3-ac5d24d2cf0e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.961237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fe39b-c8e1-4ca0-984b-b96e2037032e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:58.961237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14fe39b-c8e1-4ca0-984b-b96e2037032e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:58.962897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 357/704] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:58.966360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:58.966652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:58.966929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:58.995788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:58.997417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:59.049669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:59.131742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 358/706] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 31 12:03:59.132177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 348/706] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:03:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:03:59.134066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.202684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:59.226670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310d20-f8bd-4823-8ba5-e28e79d4f291 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.227297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310d20-f8bd-4823-8ba5-e28e79d4f291 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.227805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb310d20-f8bd-4823-8ba5-e28e79d4f291 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.229379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 349/707] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:03:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:03:59.234292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.234578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.234852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.252296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb1b66-f01f-4889-8d72-2f38e22a8c97 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:59.280097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:03:59.281320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:03:59.295890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:59.296874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.297368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.298488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.318664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:59.321511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:03:59.348066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:59.349075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:03:59.349955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:03:59.349955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:03:59.349955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:59.365396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 359/708] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:59.374419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.418688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 350/709] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:03:59.464524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.495211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac95ce-96d7-4d2c-a2ce-00a4e20de940 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:59.528351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:59.541809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:59.542769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.543266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.543743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.544597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:59.545110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:59.546781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:59.570523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 360/710] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:03:59.576416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.665818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:59.702448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c477e2-854b-48d5-a19f-5d40d0cd5f7e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:59.711432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381fd834-449b-475d-ab33-52a155a2b3dd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:59.747607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:59.748849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.749355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.749805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.759066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:59.760641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:59.761095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:59.762045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.762690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.763145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.764229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:59.765740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:03:59.773338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:59.774305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:59.775182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 361/711] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:59.776440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:59.782676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:59.783792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:03:59.784748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:03:59.792685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 351/712] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:59.793956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.836465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:03:59.894528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f8d5f-f3b4-48d9-8bf7-c3236eb74de0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:59.923008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc4c2d-3b5f-4642-9370-86e603e11328 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:03:59.934459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c128219-c596-47da-a832-164259a4a53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:59.935345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c128219-c596-47da-a832-164259a4a53e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.935460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c128219-c596-47da-a832-164259a4a53e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.935699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c128219-c596-47da-a832-164259a4a53e None admin] PATH_INFO: `/v3/services/network` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.936324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c128219-c596-47da-a832-164259a4a53e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:59.937685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c128219-c596-47da-a832-164259a4a53e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-4c128219-c596-47da-a832-164259a4a53e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:03:59.950199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:03:59.951258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:03:59.952150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 362/713] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/services/network => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:03:59.953045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c128219-c596-47da-a832-164259a4a53e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:03:59.970377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:03:59.970999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:03:59.971278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:03:59.971550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:03:59.972282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:03:59.972610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:03:59.974174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:03:59.987877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 352/714] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:03:59.988710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:00.005242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.070869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c128219-c596-47da-a832-164259a4a53e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:00.073222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.099497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5360cf0a-7488-4e8f-b6ae-16e5915a9199 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:00.112081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:00.113048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.113540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.114051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.114998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:00.115564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:00.117171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:00.122567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 363/715] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:00.123653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:00.142670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:00.143166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.143451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.143722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.144408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:00.144718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:00.146070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:00.155494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 353/716] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:03:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:00.156509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:00.239453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2c9b-5f2e-4166-b838-c0e324951210 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:00.240614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.264709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d521-55a5-4e24-9334-4995047956e7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:00.279986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:00.280949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.281426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.281890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.283478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=e1da264bfb8e41589f88d2e84528d92d) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:00.284120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:00.285761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:00.292333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 364/717] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:00 2022] GET /identity/v3/role_assignments?user.id=e1da264bfb8e41589f88d2e84528d92d&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:00.293629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:00.301940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:00.302577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.302858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.303132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.303781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:00.304138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:00.305633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5415d8-829d-427e-9971-f8fbacb85616 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:00.312908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 354/718] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 31 12:04:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:00.334971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:00.429368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7ebb2-8154-43df-9325-86da733e0bd9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:00.481031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:00.481957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.482408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.482830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.483644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] RBAC: Adding query filter params (type=network) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:00.484169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:00.485844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc420821-197b-4122-9ec8-b1e380239020 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:00.492880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 365/719] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:00.854429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e0fbc-d1e0-4d9e-99e9-1bfee1ef5800 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.854951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e0fbc-d1e0-4d9e-99e9-1bfee1ef5800 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.855421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e0fbc-d1e0-4d9e-99e9-1bfee1ef5800 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.858287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 355/720] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:00.864587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3c201-c064-4a6a-aa08-db05e6a3022c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:00.865447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3c201-c064-4a6a-aa08-db05e6a3022c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:00.865933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3c201-c064-4a6a-aa08-db05e6a3022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:00.889379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-17c3c201-c064-4a6a-aa08-db05e6a3022c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:00.890955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-17c3c201-c064-4a6a-aa08-db05e6a3022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:00.982279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 366/721] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:01.105235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206fc03-80e5-437d-b722-5dfe4b4d809b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:01.105535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206fc03-80e5-437d-b722-5dfe4b4d809b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:01.105718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b206fc03-80e5-437d-b722-5dfe4b4d809b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:01.107333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 356/722] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:01.117811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:01.118129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:01.118422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:01.144986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:01.146187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:01.168404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:01.228001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 367/723] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:01.328084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206fc03-80e5-437d-b722-5dfe4b4d809b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:01.459671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b206fc03-80e5-437d-b722-5dfe4b4d809b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:01.510599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:01.511236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:01.511515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:01.511787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:01.526087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:01.531385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:01.532857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:01.533852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 357/724] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:04:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:01.540655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:01.687246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:01.691057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:01.697721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f7aa0-1b1e-4011-8025-3993911b5f69 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:01.749612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:01.750216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:01.750521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:01.750791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:01.751452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:01.751749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:01.753150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:01.770077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 368/725] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:04:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:01.776882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:01.807257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:01.815115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88791123-122c-4579-8a78-7f56d6319fd1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:01.859402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:01.860079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:01.860405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:01.862306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:01.880852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:01.886495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:01.887509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:01.888440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:01.893253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 358/726] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:01.897089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:01.988552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b74e8-d6be-49a7-b69e-c2f7d36b7f54 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.028517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:02.052933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.053575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.053849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.054114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.067005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.068665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:02.084733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:02.085723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:02.086718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:02.086718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:02.086718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:02.090947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 369/727] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:02.092275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.110971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8427f-6dec-4c73-8f6f-3a7ff3596bd0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.153788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.154564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.154854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.155131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.155799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:02.156136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.161067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.167866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 359/728] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:02.177044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.241062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:02.252765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e31dffc-1d95-4ddf-8931-7795541ff0f1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.403075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14160164-fbaa-454f-8332-5ac1edf03190 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.418044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.418880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.419327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.419739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.420554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:02.420994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.422858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.451710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 370/729] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:02.455750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.456295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:02.480707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.481862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.482193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.482468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.495232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.496876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:02.519562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:02.520599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:02.521496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:02.521496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:02.521496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:02.532102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 360/730] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:02.532996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.605576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497f5f6-2ce8-4a98-875f-d49a59f009cc None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.633248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:02.642279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.643019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.643361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.643696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.651278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.652849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:02.665535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:02.666448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:02.667382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:02.671191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 371/731] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:02.672437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.727992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a163e9-96f7-48a9-a818-cf62c1938c28 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.764692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.765322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.765604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.765881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.767193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:02.767500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.768940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c568224-53f1-4b75-ae96-cc3f0857d955 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.776155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2290d8db-2e79-45e8-9729-bd9eb531fff6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.783274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 361/732] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:02.784544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea23c0c-ab38-4969-aec9-d839ee208cd0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.784835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea23c0c-ab38-4969-aec9-d839ee208cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.785106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea23c0c-ab38-4969-aec9-d839ee208cd0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.786479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 362/733] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:02.789492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d0c56-ad0f-45a2-8dc3-dee380d9651e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.789883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d0c56-ad0f-45a2-8dc3-dee380d9651e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.790433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d0c56-ad0f-45a2-8dc3-dee380d9651e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.791971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 363/734] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:02.793111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d0c56-ad0f-45a2-8dc3-dee380d9651e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.816953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.817812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.818244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.818658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.819533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:02.819835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.821301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab7c40-f438-482e-8316-91b3b518b272 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.833166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:02.845123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 372/735] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:02.846262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c2ff-da2a-4dac-a1e1-2379602395c3 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.846549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c2ff-da2a-4dac-a1e1-2379602395c3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.846820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7c2ff-da2a-4dac-a1e1-2379602395c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.864592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-69c7c2ff-da2a-4dac-a1e1-2379602395c3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:02.865764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-69c7c2ff-da2a-4dac-a1e1-2379602395c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:02.907213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d0c56-ad0f-45a2-8dc3-dee380d9651e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:02.922811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:02.945816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:02.946442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.946981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.947247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.948575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 373/736] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:02.949822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cee5e-b8b0-4596-b1b6-cf1b575c2aaf None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:02.950102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cee5e-b8b0-4596-b1b6-cf1b575c2aaf None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:02.950369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8cee5e-b8b0-4596-b1b6-cf1b575c2aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:02.960803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:02.962235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:02.974246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:02.975393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 364/737] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:02.976406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:02.982852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ab8cee5e-b8b0-4596-b1b6-cf1b575c2aaf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:02.985434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ab8cee5e-b8b0-4596-b1b6-cf1b575c2aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:03.055733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 374/738] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:03.057794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f1a-0b04-4b03-841f-601ae1f8b406 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.058144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f1a-0b04-4b03-841f-601ae1f8b406 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.058491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd2f1a-0b04-4b03-841f-601ae1f8b406 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.059801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 375/739] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:03.060584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f1a-0b04-4b03-841f-601ae1f8b406 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.097968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.106858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08156f26-fd2b-4b5c-b38f-041ac94075d7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.148125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.148782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.149052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.149368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.194088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd2f1a-0b04-4b03-841f-601ae1f8b406 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.205101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.225648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.227100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:03.239167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.239766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.240071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.240341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.241142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:03.241352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.242775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3c2ed-61e6-481c-a0f4-e4e9c73a4632 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:03.260916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 376/740] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 31 12:04:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:03.262048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.262379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.262651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.280359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:03.281531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:03.330633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.337633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 365/741] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:04:03.340870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.351648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 377/742] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 31 12:04:03.352595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.442621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d7fd3-b5cd-4899-b0f0-2058bdbc1913 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.458019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.465423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ff394-17a1-44f6-87aa-93df9c4e5d12 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.482740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.483372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.483646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.483913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.494994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:03.499837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:03.501593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 366/743] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:03.502583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.508846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.509654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.509936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.510207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.565497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.584705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.586154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:03.613373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b815fedb-72c3-4faa-8894-28cee26f2494 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.648691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.649312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.649585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.649849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.659544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.661020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:03.675391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:03.675593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:03.676615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:03.677502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:03.677502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:03.677502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:03.677502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 367/744] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:03.677986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.685074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 378/745] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 31 12:04:03.686179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.779632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db772b62-0e13-487e-8498-e008d9b62973 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.784579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b6f67-f473-44a8-a304-60a56041ec20 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.788125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.813854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.814455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.814731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.814999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.815641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.817070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:03.817882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.818555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.818828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.819094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.819739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:03.820068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.821780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:03.831084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 379/746] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:03.831859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.833897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 368/747] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:03 2022] POST /identity/v3/services => generated 251 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:03.834548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:03.896562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:03.951474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d4f928-7aae-4788-861c-f9a012c589ab None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.967857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098cd2d-0893-49fe-9cdc-f4b8bf345145 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:03.993166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:03.993775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:03.994054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:03.994326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:03.994974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:03.996390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.011064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.011683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.011982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.012254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.012907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:04.013209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.013495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 380/748] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:03 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:04.014303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.014663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.028431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 369/749] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:04.029334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.066039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.151500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6921150-9946-478b-b42c-68dfdeaa196a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.157883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dd2dd-e1af-4999-9974-ee9eb9a7d8df None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.173879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.191534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.192214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.192491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.193097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.204238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.205586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.206307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.206758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.206864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.208346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.220517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.222223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:04.225593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:04.226717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:04.227834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:04.227834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:04.227834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:04.227834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 370/750] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:04.227834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:04.241898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:04.243058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:04.244209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:04.244209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:04.244209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:04.246296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 381/751] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:04.247297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.322949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.347836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a96abdf-d833-41a7-9156-7aafe7641563 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.362286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee5bab-7511-4ea8-b1cd-7ff769dbadc6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.387979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.387979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.387979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.387979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.395157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.396868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.397533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.398239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.398737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.399125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.399955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:04.400391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.401856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:04.408530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:04.409435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:04.410355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 371/752] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:04.413502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.419705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 382/753] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:04.420781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.453005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.522654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357005e-41d3-471c-8e31-f6abdf675a70 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.554246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e031f8f-d25a-4135-abe8-1f0359afd9c1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.560102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.560889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.561334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.561759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.562604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:04.563655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.565322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.568508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.585173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 372/754] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:04.586228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.598940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.599978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.600377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.600750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.601944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:04.602352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.604702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.623496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 383/755] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:04.625960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.693180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f7957-48e8-4ba4-945b-88225a6c55e7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.736236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.737043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.737418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.738189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.738351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.749661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.752547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.757401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe5c6-0776-4393-b1e7-e47824d5daa4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:04.768349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:04.769511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:04.770551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:04.772019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 373/756] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:04.773003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.800798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.801831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.802308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.802926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.810752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.812512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:04.824593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:04.825506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:04.826388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:04.833792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 384/757] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:04.834944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.846534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:04.899160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841b3c9-50ca-4334-900c-79ecdc890941 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:04.947976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:04.949964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:04.950241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:04.950509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:04.951235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=c06aa3d6bf274e19946f35bf9392fce6) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:04.951545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:04.955581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:04.964819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 374/758] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/role_assignments?user.id=c06aa3d6bf274e19946f35bf9392fce6&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:04.965381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:04.979345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbfe951-2d3f-4a21-b931-b43f9cd057d1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.020087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.021025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.021559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.021976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.023025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:05.023509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.025159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.050650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 385/759] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:05.052229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:05.055589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:05.081544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddfb6ce-ce41-4b1d-9eaf-166d3dc9ef00 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.105533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:05.121871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.122691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.123064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.123431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.124268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:05.124672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.127019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.144620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 375/760] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:05.150465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:05.260875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89988df-936c-4fac-a8a3-aabe115e5fa6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.298113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.298866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.299745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.300165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.301143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=08996d25b2614149a6bc71437c96b135) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:05.301680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.303431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.310301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 376/761] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:05 2022] GET /identity/v3/role_assignments?user.id=08996d25b2614149a6bc71437c96b135&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:05.312782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2621f-d557-4a52-bbb9-05ba09b72bc0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.353144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.354186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.354675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.355155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.368177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.369975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:05.385582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:05.386609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:05.387529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:05.387529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:05.387529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:05.394730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 386/762] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:05.396408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:05.448356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:05.507322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed938-5c4d-4bf2-b33b-04c546432142 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.545496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.546114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.546439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.546715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.547453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:05.547762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.549179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.565560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 377/763] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:05.567283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:05.628375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:05.680590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbc1f0-0608-4ce3-81da-c80a9762a535 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.716605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.717236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.717556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.717830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.725342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.726809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:05.738749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:05.739674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:05.740607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:05.743010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 387/764] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:05.745993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:05.884812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0179a94-c852-4d64-adc5-f9d65d63759e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:05.887084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:05.920304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:05.920925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:05.921203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:05.921477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:05.922281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:05.922596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:05.924040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c698a60-897b-4730-bb46-1bc40970942e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:05.936539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 378/765] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:05.942641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:06.080882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249fac4d-f8ab-4cc8-82de-388ba2ee0fbc None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:06.095089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:06.128356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abb213e-4ad3-4973-b129-63d1a928d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:06.129037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb213e-4ad3-4973-b129-63d1a928d4c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:06.129314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb213e-4ad3-4973-b129-63d1a928d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:06.129589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb213e-4ad3-4973-b129-63d1a928d4c2 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/e1da264bfb8e41589f88d2e84528d92d/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:06.131538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb213e-4ad3-4973-b129-63d1a928d4c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=e1da264bfb8e41589f88d2e84528d92d, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:06.133065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abb213e-4ad3-4973-b129-63d1a928d4c2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:06.148825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 388/766] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:05 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/e1da264bfb8e41589f88d2e84528d92d/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:04:06.184594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a086a7-7c49-4fd1-92b2-f2d390c3a567 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:06.185117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a086a7-7c49-4fd1-92b2-f2d390c3a567 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:06.185117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a086a7-7c49-4fd1-92b2-f2d390c3a567 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:06.186681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 379/767] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:06.192832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc2f6-7290-4f62-869d-5ee4d6b87ee4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:06.193117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc2f6-7290-4f62-869d-5ee4d6b87ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:06.193390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1bc2f6-7290-4f62-869d-5ee4d6b87ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:06.221308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1d1bc2f6-7290-4f62-869d-5ee4d6b87ee4 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:06.222556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1d1bc2f6-7290-4f62-869d-5ee4d6b87ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:06.314593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 389/768] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:06.569632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310faa2b-a8c6-47ee-bb3f-2fbd4756d483 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:06.569913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310faa2b-a8c6-47ee-bb3f-2fbd4756d483 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:06.570185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310faa2b-a8c6-47ee-bb3f-2fbd4756d483 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:06.572056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 380/769] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:06.577253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:06.577650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:06.578023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:06.605028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:06.606236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:06.667305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310faa2b-a8c6-47ee-bb3f-2fbd4756d483 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:06.684255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 390/770] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:06.822922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310faa2b-a8c6-47ee-bb3f-2fbd4756d483 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:06.865965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:06.866667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:06.867080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:06.867495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:06.868123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:06.869532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:06.883213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:06.884250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:06.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 381/771] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Aug 31 12:04:06 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:06.892857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:06.963042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.005674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.048149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.060628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24985a3-a754-48da-a603-2dc5d8dafef1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.132942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.133481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.133755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.134021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.134657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:07.134956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.136463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.145508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 391/772] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 31 12:04:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:07.152015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.169067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c82f4-0d88-4ea7-a475-4654cb19459b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.237772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.240139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.241567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.242324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] PATH_INFO: `/v3/services/network` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.243685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.245505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:07.261846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:07.262896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:04:07.263748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:07.272461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 382/773] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:07.278137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.315316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.323139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b3f9b0-fce9-43f1-be65-08babf430830 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.384547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.385071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.385345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.385606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.386231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:07.386527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.387885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebecb36-72b1-4139-bae7-cfcb5cda3a9a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.393829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 392/774] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:07.399509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2ddd-5ff6-49f2-b14a-543129714f37 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.399509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2ddd-5ff6-49f2-b14a-543129714f37 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.399509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2ddd-5ff6-49f2-b14a-543129714f37 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.399509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 393/775] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:07.401389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2ddd-5ff6-49f2-b14a-543129714f37 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.427197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.441714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5080db-d67d-4ed3-950a-ce4cec726310 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.486910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.487691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.488077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.488416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.489154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] RBAC: Adding query filter params (name=network) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:07.489939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.491377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10db90-5fba-454a-b6b7-edc5f1c54796 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.497593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 383/776] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:07.499344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.499693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.500117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.521484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2ddd-5ff6-49f2-b14a-543129714f37 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.522684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:07.524151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:07.559636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.560757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.561251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.561767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.563407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] RBAC: Adding query filter params (interface=public, service_id=2e97486bde684fbf888e321e8a4fd194, region_id=RegionOne) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:07.564026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.565602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.579158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 394/777] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/endpoints?service_id=2e97486bde684fbf888e321e8a4fd194&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:07.580476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.608024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 384/778] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:07.610848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.618566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.749327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9934a1e-613b-42fc-88d0-f7dc415677ee None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.763131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.779436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba555a6f-2267-4381-92c9-51db6425417c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:07.787405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.788381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.788879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.789426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.790276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] RBAC: Adding query filter params (type=network) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:07.790783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.792484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239cbf-93c0-497e-a001-d7378f2e5e1a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.798657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 395/779] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:07.800154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9aba-b51a-431a-8941-79d07c45e74c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.800681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9aba-b51a-431a-8941-79d07c45e74c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.801174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c9aba-b51a-431a-8941-79d07c45e74c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.802833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 396/780] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:07.807613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9aba-b51a-431a-8941-79d07c45e74c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.822914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624d4928-b717-4c06-a1d7-043c628424d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:07.823555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4928-b717-4c06-a1d7-043c628424d2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.823836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4928-b717-4c06-a1d7-043c628424d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.824200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624d4928-b717-4c06-a1d7-043c628424d2 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.824874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d4928-b717-4c06-a1d7-043c628424d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:07.826917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624d4928-b717-4c06-a1d7-043c628424d2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:07.834038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 385/781] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:07.840421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:07.842234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:07.842737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:07.881780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:07.883537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:07.960159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:07.983990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 386/782] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:07.983990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:07.984254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c9aba-b51a-431a-8941-79d07c45e74c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.039541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.040175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.040583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.040983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.041702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] RBAC: Adding query filter params (interface=public, service_id=efc9e0237b27473dbe280b2ebc4e00fb, region_id=RegionOne) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:08.042012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:08.043505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:08.050040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 397/783] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/endpoints?service_id=efc9e0237b27473dbe280b2ebc4e00fb&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:08.055012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.094561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:08.121044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8017ff-a0ff-4599-9223-bd7034757ed5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.169248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.169885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.170162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.170429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.181529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc6811-fbf7-4343-87fc-2f6a2cb20c3e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.183032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:08.189536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:08.190671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:08.191723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 387/784] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:04:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:08.200199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.240248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.240861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.241137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.241405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.244444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:08.245818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:08.259630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 398/785] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/services => generated 772 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:08.270756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.292476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:08.355004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e391df-2cb4-48ce-a7bf-b6038c0da25c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.433749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0db5b7-4401-40da-98ff-120b1001cee9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.475739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a8cfe-b66c-4ed8-bbf5-618a1a4f5877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.476423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8cfe-b66c-4ed8-bbf5-618a1a4f5877 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.476698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8cfe-b66c-4ed8-bbf5-618a1a4f5877 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.476968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8cfe-b66c-4ed8-bbf5-618a1a4f5877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.489032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a8cfe-b66c-4ed8-bbf5-618a1a4f5877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-990a8cfe-b66c-4ed8-bbf5-618a1a4f5877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:08.495521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:08.496538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:08.497846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 399/786] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:08.498540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05672c-4a53-4f00-a906-ac84e0dd32f4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.498540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05672c-4a53-4f00-a906-ac84e0dd32f4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.498672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05672c-4a53-4f00-a906-ac84e0dd32f4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.500381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 400/787] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:08.513127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05672c-4a53-4f00-a906-ac84e0dd32f4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.534052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.534720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.535044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.535318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.536338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:08.536641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:08.538339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2202d368-3639-45a2-bf50-ee726165f286 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:08.550502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 388/788] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:08.557592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.558443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.558735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.568325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:08.581766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:08.583433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:08.619660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:08.645954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05672c-4a53-4f00-a906-ac84e0dd32f4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.672750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 389/789] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:08.673960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.689281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.690167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.691699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.692143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.692966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:08.694183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:08.695836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:08.708056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 401/790] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:08.717153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.874265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999bf76-bc5c-451f-9902-d4753113c72d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.883378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d1d64d-64a1-4630-a96d-3e8ca2d9c5ea None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:08.920575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.922726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.923577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.924381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.933369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:08.940733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:08.941379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:08.941660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:08.941932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:08.946118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:08.950253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:08.951614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:08.967698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:08.968709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:08.970283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:08.970283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:08.970283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:08.970283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 402/791] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:08.976260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:08.976568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:08.977742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:08.995653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:08.996708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:08.997602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:08.997602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:08.997602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:08.997602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 390/792] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:08.998486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.112780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc4145-e827-4457-8ad2-952518247951 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.115310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb5103-aa1e-4c20-ab05-511993ad8b1e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.151391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.152113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.152541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.152888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.153221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.153328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.153558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.153940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.154769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:09.155246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.157584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.165781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:09.175179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:09.176386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 391/794] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:09.177590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.178581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 403/794] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:09.179770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.236096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:09.252329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:09.289045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61bb427-9fff-4376-8f1a-4860e519f96e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.299395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e858f9f9-2045-4d85-86f5-2e6a4ce03b5d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.334290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.334896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.335173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.335445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.336132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:09.336432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.337794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.339605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.340721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.341247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.341717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.342606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:09.343179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.345389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.346955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 404/795] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:09.348118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.363529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 392/796] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:09.363529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.449740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4655b30-ff46-46dc-a9af-61c97a32a2fd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.463730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:09.479741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce50dc-7e4c-47d1-8110-320b645277a5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.484349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:09.499444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.501036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.501917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.502481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.513216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.514912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:09.531819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:09.532810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:04:09.533776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:09.536269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 405/797] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:09.537331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.538221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.539058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.539429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.539790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.553845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.555757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:09.575008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:09.576119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:09.577096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:09.577096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:09.577096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:09.580027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 393/798] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:09.581009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.652732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e299c-5140-4fb5-9618-33b7da057794 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.686614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.687330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.688271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.688642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.693259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315cab2-b427-4aaa-b7a3-3f6f16d33d04 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.696818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.698146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:09.710360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:09.711550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:09.712556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 406/799] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:09.713152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.739749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.740646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.741001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.741454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.742689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:09.743206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.745607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.759925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:09.768628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 394/800] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:09.769974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.790030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:09.852759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900c064-0ed2-4c30-b84f-cb1dd6dfdc1e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.899924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.900688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed13d2b-9fa1-4e70-ac79-5700e87fa9d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:09.901232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.901716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.902435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.904212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:09.904749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.906880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.932992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 407/801] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:09.932992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:09.950841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:09.955853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:09.955853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:09.955853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:09.955853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:09.955853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:09.956944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:09.980073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 395/802] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:09.981446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.055163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.062667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203e27de-676b-447d-8cf7-fd566b547358 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.064769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.099925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.100749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.101119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.101492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.102137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb86c9f-2d71-4705-80cc-3d59c79d9eac None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.114483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.116219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:10.133068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:10.134259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:10.135354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:10.135354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:10.135354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:10.135354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 408/803] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:10.135641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.150048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.151178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.151633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.152315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.161966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.163460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e489e523-b647-4428-9aa9-194728862e97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:10.176038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:10.181747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 396/804] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:04:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e508f-e1e5-49ad-b157-b7a94de5e7a4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.182699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e508f-e1e5-49ad-b157-b7a94de5e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.183430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e508f-e1e5-49ad-b157-b7a94de5e7a4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.183430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 397/805] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:10.183430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e508f-e1e5-49ad-b157-b7a94de5e7a4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.253862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab56e5d4-314c-4906-ac64-4345e274b60d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.289649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.290278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.290556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.290891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.295804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e508f-e1e5-49ad-b157-b7a94de5e7a4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.302466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.304031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.310716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:10.319683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:10.320841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:10.322037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:10.322037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:10.322037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:10.322037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 409/806] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:10.322297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.336799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.344258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.345068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.345475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.345895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.346729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:10.347105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.348577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14814b83-01b6-42bb-a1a3-3f019e91490b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.361098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 398/807] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:10.362351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.362635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.362916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.380012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:10.381202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:10.428681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f176701-f19d-49cb-956a-05e0eaee5c08 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.445478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 399/808] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:10.446291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.464068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.464969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.465254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.465520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.466252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:10.466554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.468736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922cdc3-b846-43a4-9258-e03c73613a6d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.491021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 410/809] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:10.492102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329c52-cb44-4e39-b778-3d8b51d63f28 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.492375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329c52-cb44-4e39-b778-3d8b51d63f28 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.492649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08329c52-cb44-4e39-b778-3d8b51d63f28 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.493981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 411/810] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:10.498439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329c52-cb44-4e39-b778-3d8b51d63f28 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.552196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d821c7b-4cbd-4677-84b5-f3327a1f4167 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.557662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.576075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.588401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.589004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.589280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.589554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.590190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:10.590488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.591854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.608239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 400/811] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:10.608239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.613881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08329c52-cb44-4e39-b778-3d8b51d63f28 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.651428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.652221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.652504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.652768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.660045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.661472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8eff72ad-5909-44a4-8b64-ca7587ee553c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:10.673148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:10.674265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:10.675384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:10.676180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 412/812] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:10.681551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.681551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.681551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.697339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:10.698744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:10.717615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625d2b6-3043-483d-a982-1c69855578fc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.751905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.755808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.755808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.755808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.768365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 413/813] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:10.769217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.808235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.819837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:10.831662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.833617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.875837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b1f663-c043-4cad-a5d5-819e9503a225 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:10.912556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:10.913298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:10.913650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:10.914075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:10.926885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:10.928564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:10.942086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:10.943206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:10.944358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:10.951244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 414/814] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:10.951398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 401/815] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:10.951484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:10.951634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.042401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.059339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b25000-9c3d-4e55-aabd-e92aef8b05bb None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.061482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171cb8f-f4a7-44ca-9193-955afe1f1308 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.066181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.092872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.093524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.094335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.094605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.095289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:11.095589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.095838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.096499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.096830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.097037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.097143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.097658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.099045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:11.107838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:11.109038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 31 12:04:11.110705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:11.111670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 415/816] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:11.111670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.112826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 402/817] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Aug 31 12:04:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:11.114598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.212931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae312d-63cd-4baf-a55f-a127c23f3110 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.213391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469dc7c-cd60-4a3c-ad9d-b9aa7a300a96 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.245771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.246364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.246646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.246917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.247105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.247601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:11.247720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.247911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.248057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.248276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.249365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.259059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.260505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.261566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 416/818] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:11.262131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.267067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:11.275803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:11.277024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:11.278278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:11.278278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:11.278278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:11.278278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 403/819] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:11.278278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.294141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.367656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197c492-94e0-4619-bffc-ae7f0d20ee6e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.378508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e039834-fc14-4fe1-a3cf-9539246b50fb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.400155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.400769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.401044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.401317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] PATH_INFO: `/v3/services/network` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.401884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.403264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.410672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.411322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.411599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:11.411745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:11.412875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 31 12:04:11.413906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:11.414802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/08996d25b2614149a6bc71437c96b135/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.414802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=08996d25b2614149a6bc71437c96b135, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.415416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.417620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 417/820] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:11.418426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.433480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 404/821] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:11 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/08996d25b2614149a6bc71437c96b135/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:04:11.434440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.501065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.532339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.544787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c7be5-018f-4fb1-96ba-7c5ae0490897 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.551680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40873273-8549-4ebc-8e7d-c39da62ec6e0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.594454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.595159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.595502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.595610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.595878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.596216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.596496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.596770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/c06aa3d6bf274e19946f35bf9392fce6/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.596880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:11.597204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.598693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.608426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 418/822] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:11.608426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.615810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=c06aa3d6bf274e19946f35bf9392fce6, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.617314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.633290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 405/823] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:11 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/c06aa3d6bf274e19946f35bf9392fce6/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:04:11.634327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.743304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1095a637-d481-4d78-b376-0de254340db5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.787534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f258064-e912-4057-b371-1b6c36d8551c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.789456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.790385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.790668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.790938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.791581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:11.791910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.794147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.797534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.808183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 419/824] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:11.808183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.826677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:11.831598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.832249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.832526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.832795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.833435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] RBAC: Adding query filter params (name=network) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:11.833733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.835098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.841576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 406/825] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:11.842388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:11.939731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aab3ce-89d6-49a5-abd9-aa83c0a74a9a None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.951673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96461cb-4ca8-472e-9481-737bf653470e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:11.983310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.984876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.985308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.986038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.987116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:11.987570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:11.989835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:11.993706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:11.994364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:11.994741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:11.995108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:11.996960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 420/826] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:11.998263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:12.004472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:12.006090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:12.020573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:12.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:12.022779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:12.025276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 407/827] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:12.026471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:12.084699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:12.096327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:12.111746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa436b8-af29-462e-875f-2a2dc5120ac6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:12.156792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:12.157681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:12.158106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:12.158522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:12.158803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687af09-4354-4ca4-9174-63dd1a4d23a6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:12.159469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:12.159913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:12.161449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:12.166950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 421/828] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:12.167928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:12.207915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:12.208473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:12.208752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:12.209018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:12.209680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:12.211601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:12.239728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 408/829] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:12 2022] POST /identity/v3/endpoints => generated 346 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:12.240621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:12.295372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ea78c-e964-4a16-a7ea-be44119511a6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:12.378671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:12.379595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:12.380050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:12.380466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:12.381342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:12.381815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:12.383499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:12.396071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:12.405355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:12.411972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 422/830] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:12.414265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:12.431318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b07b93a-db86-444c-9357-c47033668e35 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:12.468031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd4f72-18e1-405f-80b6-d7a849fc86af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:12.469236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4f72-18e1-405f-80b6-d7a849fc86af None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:12.469522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4f72-18e1-405f-80b6-d7a849fc86af None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:12.469796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd4f72-18e1-405f-80b6-d7a849fc86af None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:12.470528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd4f72-18e1-405f-80b6-d7a849fc86af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:12.472126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd4f72-18e1-405f-80b6-d7a849fc86af None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:12.497147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 409/831] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:12 2022] POST /identity/v3/endpoints => generated 337 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:12.535468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d53d-1299-435e-801b-9c67cb1f9197 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:12.580046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:12.580649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:12.580923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:12.581186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:12.581942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=e1da264bfb8e41589f88d2e84528d92d) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:12.582223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:12.583689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167036f-cf02-47bd-a65c-d9d5eb4b7357 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:12.592918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 423/832] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:12 2022] GET /identity/v3/role_assignments?user.id=e1da264bfb8e41589f88d2e84528d92d&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:13.539972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6cd5-9e26-43e8-9965-e382e6c68368 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:13.540532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6cd5-9e26-43e8-9965-e382e6c68368 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:13.540981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a6cd5-9e26-43e8-9965-e382e6c68368 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:13.543411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 410/833] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:13.551838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5de3c4-292e-423d-8cc5-a235aafd0c3a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:13.565315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5de3c4-292e-423d-8cc5-a235aafd0c3a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:13.565315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5de3c4-292e-423d-8cc5-a235aafd0c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:13.577617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8a5de3c4-292e-423d-8cc5-a235aafd0c3a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:13.579114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8a5de3c4-292e-423d-8cc5-a235aafd0c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:13.637825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:13.654333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 424/834] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:13.692587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a151e5-8dda-43a6-975c-d7de6f9f345f None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:13.693134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a151e5-8dda-43a6-975c-d7de6f9f345f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:13.693562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a151e5-8dda-43a6-975c-d7de6f9f345f None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:13.695364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 411/835] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:13.700915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:13.701303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:13.701676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:13.721576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:13.722900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:13.791864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 425/836] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:13.942398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a151e5-8dda-43a6-975c-d7de6f9f345f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.054184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a151e5-8dda-43a6-975c-d7de6f9f345f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.069917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.090329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.091308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.091739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.092191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.104852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:14.110805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:14.112054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:14.113192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:14.115550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 412/837] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:14.121825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.126195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.187525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6488a944-a7aa-45e6-a403-fa62571de736 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.207319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.226864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.227865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.228389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.228985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.235978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db92c04-4c32-430b-949c-e879c4eac3ee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.240983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:14.246412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:14.247359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:04:14.248216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:14.255670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 426/838] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:14.256916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.271680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.272326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.272602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.272871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.273531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:14.273866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.275188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.286886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 413/839] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:14.292406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.363614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.370745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83082879-b1c9-462d-9972-740b3f6e6919 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.400740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690e47d6-4deb-4304-bebb-9109bce558a0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.408624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.409570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.410074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.410554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.411535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:14.412074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.413728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.427562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 427/840] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:14.428931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.436862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.437582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.437857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.438122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.449633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.451212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:14.467461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:14.468539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:14.470051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:14.470051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:14.470051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:14.474041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 414/841] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:14.475143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.481422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.545485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e48b0-d859-426f-a815-9da6f72ee8aa None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.576869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99620a54-523e-4b4f-a7e7-fb541be178ba None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.580967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.581606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.583020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.583301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.595356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.596656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.598261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-2785e2e9-44de-4644-a16e-832756194aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:14.614430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:14.615405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:14.616527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:14.616527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:14.616527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:14.620125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 428/842] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:14.622049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04097771-87f1-41a0-ab28-b65be319d408 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.622335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04097771-87f1-41a0-ab28-b65be319d408 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.622615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04097771-87f1-41a0-ab28-b65be319d408 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.623906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 429/843] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:14.624623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04097771-87f1-41a0-ab28-b65be319d408 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.626688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.627313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.627593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.627867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.628666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:14.628997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.631166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d09bc-1204-4855-9eb8-c4fc747fa03c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.646095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 415/844] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:14.647370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c6c-d1e4-42aa-8913-78535ac21d96 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.647656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c6c-d1e4-42aa-8913-78535ac21d96 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.647928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da58c6c-d1e4-42aa-8913-78535ac21d96 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.649317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 416/845] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:14.650209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d71c-cfb1-4492-948a-05d59829b79e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.650490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d71c-cfb1-4492-948a-05d59829b79e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.650760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a428d71c-cfb1-4492-948a-05d59829b79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.668178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a428d71c-cfb1-4492-948a-05d59829b79e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:14.669371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a428d71c-cfb1-4492-948a-05d59829b79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:14.719793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.729353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04097771-87f1-41a0-ab28-b65be319d408 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.735734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 417/846] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:14.737000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.737284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.737554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.761117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:14.762304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:14.764104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.764709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.764980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.765247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.766445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:14.766746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.768131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.780381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 430/847] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:14.781457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.838264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 418/848] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:14.839469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:14.880133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:14.906402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825a72a-57c6-4172-8075-cfa4f96f9080 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.944123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:14.944760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:14.945095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:14.945376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:14.954495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:14.955998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:14.963881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c48c2-2c0a-4038-8659-00baf21cea7d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:14.971398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:14.972601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 31 12:04:14.973604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:14.974157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 431/849] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:14.987464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.014169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.014583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.015283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.016122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.016394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.023820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.025290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:15.037321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:15.038284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.039315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 419/850] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:15.039925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.109871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb0665-782d-41d5-ba4b-9a4c06108963 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.139906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.144409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7d53f-e78c-40f2-82ae-40ed23f9b4ef None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.145793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.146396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.146673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.146947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.147680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:15.148038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.149518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.168113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 432/851] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Aug 31 12:04:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:15.168916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.178698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.179329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.179602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.179867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.180475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.181820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:15.190344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:15.191489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.192412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 420/852] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:15.193230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.244039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.276393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6feb9f-c387-4434-b777-d83da4d36d4f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.305101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b48f-1e2d-46d0-a83a-e046945f4d29 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.310561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.311175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.311457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.311731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.313067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:15.313401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.314849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.336670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 433/853] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:15.336670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.339064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.339697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.339994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.340269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.340877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.342265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:15.351706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:15.352897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.353797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 421/854] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:15.354640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.380924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.441138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1635-8ca5-4695-82cf-2b3a9175f12b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.452278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5b03d-4589-4cbe-8581-f71c5a254e8a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.466723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.475339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.475933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.476232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.476499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.486378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.486977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.487253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.487524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.488165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:15.488465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.489812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.494094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 422/855] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:15.494858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.541355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.542794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.583230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.592845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e5010-d325-4717-85a0-52bd2d694deb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.626084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.626681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.626956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.627224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.640859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 434/856] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:15.641710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.669666 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.700441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.701822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.743793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e386a621-6a58-47c8-bcd8-78ba7712ad46 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.777481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.778074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.778378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.778671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.779291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:15.779590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.780980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.785321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 435/857] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:15.786156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.792206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.803757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 423/858] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:15.804708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.877239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:15.886394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658624ab-46bd-4075-9ee9-8ee28e19aaab None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.903159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09fd3c-bc31-4767-8fd3-4dd117f51bbf None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:15.922558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.923209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.923973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.924262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.924906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:15.925211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.926588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.931227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 436/859] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:15.932022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:15.948175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:15.948927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:15.949291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:15.949659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:15.962655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:15.964277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:15.981779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:15.983042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:15.984006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:15.984006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:15.984006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:15.984006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 424/860] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:15.984448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.036724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.057635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cbf47-1f83-4593-a74a-bc1e19c90b53 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.101571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.102183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.102524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.102796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.103486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.103792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.105198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.106906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb572b1-f389-4c5e-81b2-fec846e46abc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.110094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 437/861] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:16.110888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.136821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.172585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.174365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.174830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.175260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.192842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.195631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:16.217575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:16.218845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:16.219998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:16.219998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:16.219998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:16.222796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 425/862] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:16.232082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.235206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262227ff-8a2b-4a85-b7c3-7f1353f04481 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.273092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.273702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.273983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.274309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.275072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.275374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.276916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.290912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 438/863] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:16.296318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.351798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.360890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32426359-df90-4f4d-bfd9-62ecd41ac021 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.381741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.403025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cd455-7d3e-4fbe-bd81-ddc03752f28e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.405339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.407921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.408443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.408864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.409782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.410236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.411918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.432317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 426/864] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:16.434087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.442177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.442900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.443252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.443593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.451166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.453643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:16.465165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:16.466106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:16.467380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 439/865] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:16.471980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.543281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec0ddd-9386-4a52-8673-bd9cf2ad34b7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.582494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.583498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.584526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.584682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b479cbf-b107-4564-b1c3-d0fe6d109171 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.585144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.595970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.595970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:16.607532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:16.608731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:16.610821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 427/866] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:16.615085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.622489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.623130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.623494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.623805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.624558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.625487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.627044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.631403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.638703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.643545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 440/867] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:16.649237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.724093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8487d-5b62-4ba9-92bc-679bea0e26e4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.759453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.760114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.760364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.760636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.761390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.761700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.763212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.780801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b146c3a6-4904-424f-afc4-ec2b8e3e7fd0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.782143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 428/868] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:16.783028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:16.825480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.826698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.827140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.828415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.829621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=08996d25b2614149a6bc71437c96b135) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.830085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.832244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e76ce-bb26-478e-a47a-9bb4d5df0132 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.840212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 441/869] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/role_assignments?user.id=08996d25b2614149a6bc71437c96b135&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:16.874284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:16.904605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468611e-b903-4602-9b8c-a641a3a29fb8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:16.943610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:16.944263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:16.944538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:16.944809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:16.945549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=c06aa3d6bf274e19946f35bf9392fce6) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:16.945855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:16.947568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ee622-fd8b-402b-a04d-527bc43e6d5c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:16.955185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 429/870] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:16 2022] GET /identity/v3/role_assignments?user.id=c06aa3d6bf274e19946f35bf9392fce6&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:17.925942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112045-da07-49b0-918f-804d5a3f8246 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:17.926461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112045-da07-49b0-918f-804d5a3f8246 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:17.926542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70112045-da07-49b0-918f-804d5a3f8246 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:17.928166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 442/871] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:17.933266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5185-f41e-421c-8dc8-9dade795a399 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:17.933688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5185-f41e-421c-8dc8-9dade795a399 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:17.933857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec5185-f41e-421c-8dc8-9dade795a399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:17.952533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4dec5185-f41e-421c-8dc8-9dade795a399 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:17.954264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4dec5185-f41e-421c-8dc8-9dade795a399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:18.027913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 430/872] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:18.162499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a8b1a-5f2f-4663-9ae4-b930777507d0 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:18.162825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a8b1a-5f2f-4663-9ae4-b930777507d0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:18.163033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a8b1a-5f2f-4663-9ae4-b930777507d0 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:18.164754 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 443/873] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:18.169848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:18.170129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:18.170399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:18.189332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:18.190502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:18.252444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:18.263347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 431/874] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:18.319678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a8b1a-5f2f-4663-9ae4-b930777507d0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:18.387455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:18.430274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a8b1a-5f2f-4663-9ae4-b930777507d0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:18.469850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4d2d5-f9c9-4d30-a028-620c9163cd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:18.470382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4d2d5-f9c9-4d30-a028-620c9163cd83 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:18.470714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4d2d5-f9c9-4d30-a028-620c9163cd83 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:18.470996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4d2d5-f9c9-4d30-a028-620c9163cd83 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:18.471661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4d2d5-f9c9-4d30-a028-620c9163cd83 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:18.473176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4d2d5-f9c9-4d30-a028-620c9163cd83 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:18.489711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 444/875] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:18 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:18.530306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:18.636124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dd5e66-09ea-4057-8f5d-217ae23ad6a6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:18.679987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f31d08-a768-4347-bc2d-c9df2408f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:18.680612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31d08-a768-4347-bc2d-c9df2408f1ae None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:18.680884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31d08-a768-4347-bc2d-c9df2408f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:18.681145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f31d08-a768-4347-bc2d-c9df2408f1ae None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:18.681779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f31d08-a768-4347-bc2d-c9df2408f1ae None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:18.683132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f31d08-a768-4347-bc2d-c9df2408f1ae None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:18.699359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 432/876] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:18 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:18.871419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218f9c-0226-420f-8f55-4926ed51d7e9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:18.871826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218f9c-0226-420f-8f55-4926ed51d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:18.872027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a218f9c-0226-420f-8f55-4926ed51d7e9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:18.873379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 445/877] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:18.879454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e56c-85e8-4c32-8c2a-8586d95b6ca1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:18.879750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e56c-85e8-4c32-8c2a-8586d95b6ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:18.880049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45e56c-85e8-4c32-8c2a-8586d95b6ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:18.905695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ac45e56c-85e8-4c32-8c2a-8586d95b6ca1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:18.906982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ac45e56c-85e8-4c32-8c2a-8586d95b6ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:18.961154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:18.987346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 433/878] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:18 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:19.013405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7518c-50bd-4f79-8d8b-7b7829997cf0 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.014332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7518c-50bd-4f79-8d8b-7b7829997cf0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.014803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a7518c-50bd-4f79-8d8b-7b7829997cf0 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.016672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 446/879] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:19.022084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.022627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.023095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.048267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:19.049797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:19.120057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 434/880] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:19.268856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7518c-50bd-4f79-8d8b-7b7829997cf0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:19.371103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a7518c-50bd-4f79-8d8b-7b7829997cf0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:19.394371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:19.403848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:19.407515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:19.408222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.408497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.412062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.412062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:19.412062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:19.422680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:19.423674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:19.424568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:19.427061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 447/881] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:19.435250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:19.525648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6817a-8816-42dd-a9f3-b243ab749e7a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:19.537935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:19.559447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec63f70-77c6-4ce8-861b-1554c81ae5a8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:19.563801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:19.564724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.565240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.565717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.577360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:19.583265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:19.584277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:19.585137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:19.589229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 435/882] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:19.590628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:19.601815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:19.602758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.603224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.603732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.604589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:19.605110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:19.606642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:19.617149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 448/883] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:19.618137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:19.675593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:19.727763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190dbaf-24ea-4124-8f06-0efd1f7561d3 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:19.728319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6551048c-ef34-4fb5-b911-a20855da8c01 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:19.764284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:19.765027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.765438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.765810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.766541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:19.767053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:19.768508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:19.772635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:19.773412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.773839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.774238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.775100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:19.775530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:19.777137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:19.779105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 449/884] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:19.792062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 436/885] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:19.793740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:19.904988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b141c10-b6b5-43db-9813-6d7b365a05f3 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:19.932162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:19.958115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:19.958351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:19.958571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:19.958857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:19.972510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:19.973967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:19.989051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:19.990081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:19.991202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:19.991202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:19.991202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:19.991202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 450/886] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:19.997281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:20.031148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:20.101572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752b7e0-ae4c-4c60-bd54-2ea833b3fd5d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:20.136144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:20.136757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.137033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.137337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.137976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:20.138271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:20.139623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:20.157946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 437/887] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:20.159353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:20.267790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa2cca5-3bcf-420f-a91b-9340fa85bb5a None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:20.304818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:20.305369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.305643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.305910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.313934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:20.315395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:20.327222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:20.328774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:20.329857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 451/888] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:04:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:20.336651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:20.432021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:20.441167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d2ed1-b800-4690-a342-8c8f91f4225f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:20.476462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:20.477070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.477343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.477606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.478331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:20.478631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:20.480071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294de30-36d2-419f-9f2b-a827ea66289d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:20.503177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 438/889] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 31 12:04:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:20.504591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:20.522114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cd74a-c7f0-4675-9cd5-d82fa8d94125 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.522438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cd74a-c7f0-4675-9cd5-d82fa8d94125 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.522673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193cd74a-c7f0-4675-9cd5-d82fa8d94125 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.524307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 439/890] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:20.529309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ce11-b992-4a55-866d-926232fef415 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.529589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ce11-b992-4a55-866d-926232fef415 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.529864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ce11-b992-4a55-866d-926232fef415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.536872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:20.548972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1c32ce11-b992-4a55-866d-926232fef415 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:20.550165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1c32ce11-b992-4a55-866d-926232fef415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:20.616542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f7ff4-da8d-4f80-acec-603ac09fd242 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:20.622308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 440/891] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:20.651164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:20.651771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.652089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.652364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.726863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:20.728345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:20.755895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:20.789593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b1e5f-1f02-4481-812e-9b6887792bd0 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.790202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b1e5f-1f02-4481-812e-9b6887792bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.790679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8b1e5f-1f02-4481-812e-9b6887792bd0 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.792511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 441/892] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:20.798984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:20.799497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:20.800013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:20.820931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:20.822759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:20.840098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 452/893] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:20 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:20.844939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:20.898544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 442/894] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:20.899703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:20.924937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:20.970586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8f10b-8a74-4c52-9122-3728d8c1e1f4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.008790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.017266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd719f9b-cb78-4e6c-9875-ca134e4c4c71 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.023640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.024590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.025049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.025496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.040559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.042738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.054614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.057051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.057051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.057051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.058121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.060939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:21.064359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:21.065270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:21.066151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:21.066151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:21.066151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:21.069215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 453/895] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:21.074982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:21.079539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:21.080782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:21.081843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.086727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 443/896] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:21.087940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.171613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.198743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb4ac57-ad2b-4c03-bdef-42b1eaa624d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.224980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd341c9-639b-4ea9-bf7b-ec809d271047 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.235450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.236102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.236381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.236650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.237280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.237584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.239004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.245001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 444/897] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:21.246107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.269994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.270879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.271375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.271713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.272515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.272965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.274691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.289238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 454/898] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:21.290230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.347428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.365769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a3a92-5ded-47d9-b358-d659799e5c1d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.402558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.408289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.408795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.409244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.410011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.411579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.417457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0c83e-7c50-4819-8cea-5cd682d20a33 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:21.422883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:21.423804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:21.424733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.429207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 445/899] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:21.430010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.435506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.471628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.472282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.472562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.472836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.473471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.473773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.475169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.485704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 455/900] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:21.486599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.562551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437194b-a648-4694-b738-f3628c43eb3c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.611666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.612443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.612719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.613237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.619324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e5475-ce38-4980-828e-87123896f101 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.619855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.621329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.626311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:21.633784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:21.634684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:21.635618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:21.640653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 446/901] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:21.641734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.674426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.675211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.675492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.675761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.676664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.676982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.679242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.687475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 456/902] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:21.688572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.709749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.755392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ac8aaa-047a-4b4e-a471-6da2ffee1099 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.790172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.791054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.791335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.791602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.792353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] RBAC: Adding query filter params (interface=public, service_id=0b31a8ee27d34dc1b21edf64d3b558bf, region_id=RegionOne) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.792642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.794034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.802044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 447/903] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/endpoints?service_id=0b31a8ee27d34dc1b21edf64d3b558bf&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:21.802829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.813462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c284362c-a053-4792-9294-f3e686b65121 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.860246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.861229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.861581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.862367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.862929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.863238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.864702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.877225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 457/904] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:21.878015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.904989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.912000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d138dcd-2009-496c-a03a-39c6ea4497e0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:21.938010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:21.947747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:21.948391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.948671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.948939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.949568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:21.949866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:21.951225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c205311-1c4c-4eba-b507-0beb69571604 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:21.956475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 448/905] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:21.957739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7d38-25c1-44e3-a1ef-3e8270b69ee3 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:21.958028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7d38-25c1-44e3-a1ef-3e8270b69ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:21.958304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd7d38-25c1-44e3-a1ef-3e8270b69ee3 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:21.959645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 449/906] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:21.960273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7d38-25c1-44e3-a1ef-3e8270b69ee3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:21.983215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd56cb4-8a8c-4cdd-ac77-393f4847fd67 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:22.017511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:22.018115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:22.018394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:22.018671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:22.019265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:22.020682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:22.026410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 458/907] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/services => generated 1268 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:04:22.027177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:22.079885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbd7d38-25c1-44e3-a1ef-3e8270b69ee3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:22.120238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:22.121221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:22.121797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:22.122073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:22.122812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] RBAC: Adding query filter params (role.id=d795374e41484e748ed2fc7dc6a51af7, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=c06aa3d6bf274e19946f35bf9392fce6) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:22.123121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:22.124781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c67e4f-9c38-4ac0-b3a7-7409bc228005 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:22.125588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:22.133167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 450/908] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:21 2022] GET /identity/v3/role_assignments?user.id=c06aa3d6bf274e19946f35bf9392fce6&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=d795374e41484e748ed2fc7dc6a51af7 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:22.135824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80df9d30-0c31-4185-a101-4b549ed58fc8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:22.141752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:22.142413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:22.142957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:22.169563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:22.172372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:22.179866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:22.180950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:22.181384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:22.181841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:22.182728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] RBAC: Adding query filter params (interface=public, service_id=827c1a632e384faf8f78630e27c9db43, region_id=RegionOne) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:22.183222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:22.185016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:22.191600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 459/909] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:22 2022] GET /identity/v3/endpoints?service_id=827c1a632e384faf8f78630e27c9db43&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:22.198852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:22.230958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:22.260436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 451/910] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:22.323621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ca054c-9260-48b0-a307-c58594af71ef None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:22.360564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20541e49-5815-4ba7-93e8-02b3bbc4b6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:22.361180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20541e49-5815-4ba7-93e8-02b3bbc4b6d8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:22.361463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20541e49-5815-4ba7-93e8-02b3bbc4b6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:22.361736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20541e49-5815-4ba7-93e8-02b3bbc4b6d8 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:22.362340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20541e49-5815-4ba7-93e8-02b3bbc4b6d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:22.363713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20541e49-5815-4ba7-93e8-02b3bbc4b6d8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:22.370010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 460/911] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:22 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:04:22.536942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:22.641189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acaa89-7512-478b-a1a1-62791e952acf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:22.675821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a281c-9871-40ee-92a6-0531d5c59486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:22.676465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a281c-9871-40ee-92a6-0531d5c59486 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:22.676739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a281c-9871-40ee-92a6-0531d5c59486 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:22.677008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a281c-9871-40ee-92a6-0531d5c59486 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:22.677653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a281c-9871-40ee-92a6-0531d5c59486 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:22.679017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a281c-9871-40ee-92a6-0531d5c59486 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:22.694704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 452/912] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:22 2022] POST /identity/v3/services => generated 241 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:24.097612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad419-0736-46f8-93d3-316965c8aa7b None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.098658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad419-0736-46f8-93d3-316965c8aa7b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.099156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ad419-0736-46f8-93d3-316965c8aa7b None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.100975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 461/913] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:24.106530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652d321-e7db-49be-9210-38ddcc7baa6a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.107340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652d321-e7db-49be-9210-38ddcc7baa6a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.107824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652d321-e7db-49be-9210-38ddcc7baa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.119664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b0a5d-978b-4b82-b0b5-2aab66ff9b4a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.119999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b0a5d-978b-4b82-b0b5-2aab66ff9b4a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.120271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68b0a5d-978b-4b82-b0b5-2aab66ff9b4a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.121857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 462/914] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:24.131157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f87e-dd03-43d2-89c1-b1299322e602 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.131570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f87e-dd03-43d2-89c1-b1299322e602 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.131965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4f87e-dd03-43d2-89c1-b1299322e602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.132524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a652d321-e7db-49be-9210-38ddcc7baa6a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:24.135414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a652d321-e7db-49be-9210-38ddcc7baa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:24.152129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-90f4f87e-dd03-43d2-89c1-b1299322e602 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:24.153468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-90f4f87e-dd03-43d2-89c1-b1299322e602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:24.169716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:24.182444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:24.231752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 453/915] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:24.246383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 463/916] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:24.386253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3b84-8f1a-4242-b267-db73cc6b172d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.386700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3b84-8f1a-4242-b267-db73cc6b172d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.387071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce3b84-8f1a-4242-b267-db73cc6b172d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.388837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 454/917] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:24.394632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.395035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.395416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.414244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:24.415420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:24.488886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 464/918] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:24.520910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce3b84-8f1a-4242-b267-db73cc6b172d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:24.555382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:24.628498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce3b84-8f1a-4242-b267-db73cc6b172d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:24.646431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:24.665267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:24.665903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.666183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.666458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.666955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74298c09-05d5-4d99-bc0d-9794e3367a09 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:24.667060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:24.668464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-85aed810-f512-4bb6-9ea0-fb21c70c7798 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:24.677396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:24.678430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:24.679296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 455/919] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:24.680122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290a476-230a-4849-bde2-c158d7edddb2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.681010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290a476-230a-4849-bde2-c158d7edddb2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.681010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290a476-230a-4849-bde2-c158d7edddb2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.681854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 456/920] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:24.686378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290a476-230a-4849-bde2-c158d7edddb2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:24.709199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7333de0-d442-4ebc-be52-aea72ce037c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:24.709875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333de0-d442-4ebc-be52-aea72ce037c5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.710159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333de0-d442-4ebc-be52-aea72ce037c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.710441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7333de0-d442-4ebc-be52-aea72ce037c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.722477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7333de0-d442-4ebc-be52-aea72ce037c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:24.725385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-e7333de0-d442-4ebc-be52-aea72ce037c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:24.728308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:24.729249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:24.730108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:24.732547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 465/921] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 31 12:04:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:24.733318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.734124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.734409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.752690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:24.753765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:24.799682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290a476-230a-4849-bde2-c158d7edddb2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:24.820931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 466/922] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:24.822028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:24.845024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:24.845634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.845906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.846174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.846828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:24.847129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:24.848532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:24.853500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 457/923] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:24.854123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:24.897499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:24.936638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208a2a6-41f3-46bf-bc50-b5bffb30f667 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:24.961276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31aedbc-3408-4a9e-b181-107d4d4f97c6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:24.963193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:24.979202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:24.979809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:24.980128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:24.980398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:24.981056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:24.981352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:24.982725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:24.995054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 467/924] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:04:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:24.995054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.003055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.003741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.004042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.004315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.005010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.006378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:25.016566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:25.017504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.018488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 458/925] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Aug 31 12:04:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:25.019991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.099279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137dee03-7e42-4dfd-a71a-9ccb3b103731 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.126753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ce047-10fc-4909-b277-b2c1c67cb52f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.136594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.143200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.143802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.144182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.144450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.145074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:25.145371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.146734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.151428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 468/926] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Aug 31 12:04:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:25.152217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.163934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.164597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.164880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.165151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.175250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.176849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:25.192202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:25.193354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:25.194425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:25.194425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:25.194425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.196361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 459/927] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:25.197439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.214206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.258927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1662ecb-d15e-46f9-b35d-5e80aa2b1179 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.293055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.293721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.294035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.294318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.294995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:25.295300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.296739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.298987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb81f9a-1cd3-4fab-8a32-21410aacfa17 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.301751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 469/928] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:25.302577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.334794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.335418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.335701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.335991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.336564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.337932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:25.346838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:25.347939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:25.349402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 460/929] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:25.350270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.364437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.405193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26565b0f-8e2f-44c2-b1da-708836f3451b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.428895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.438322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.438920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.439196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.439461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.440144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.441504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.451423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43d1f4-2319-434f-8987-5caa777af96b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.463179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 470/930] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:25.464014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.494243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.494963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.495245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.495510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.496228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:25.496534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.497940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.511378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 461/931] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:25.512027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.614796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8739-6c53-4908-8a8e-2ad4fcef01b8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.634459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688580b1-7e00-44bb-af50-49d428545aef None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.635527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.657901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.658612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.658985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.659329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.660006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:25.660313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.661696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.666712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 471/932] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:25.672091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.673633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.674323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.674606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.674882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.675542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:25.675843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.677278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.678432 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.682749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 462/933] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:25.683343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.784069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8031d8a-b171-4c04-813a-4603b2cc5143 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.802106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90bf7d5-0125-4e15-b6c3-0bb3dc8795d0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:25.822291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.822925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.823201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.823885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.832770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.834391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.838862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:25.839476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:25.839755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:25.840058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:25.840725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:25.842075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:25.848686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:25.849691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:25.850658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:25.854114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 472/934] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:25.855137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.875992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 463/935] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:25.875992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:25.920775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:25.945765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:26.015632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35356497-aa8b-43f7-9e3a-de61157727c8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.022426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77170578-be66-4c23-8ab6-a2b5e4498ddf None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.057022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.057551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.057828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.058097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.058729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:26.059027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.060433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.066860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 473/936] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:26.073144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.077386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.078949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.078949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.078949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.079780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:26.079780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.081246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.106657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 464/937] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 31 12:04:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:26.110093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.184951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5649c-3de2-44ee-aeb5-27e789212831 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.187817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:26.221055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.221657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.221933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.222202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.222901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] RBAC: Adding query filter params (interface=public, service_id=0f1c191e8c52443f86c9fd7cfd414199, region_id=RegionOne) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:26.223200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.224600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.228592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e16811-d8c9-4969-8dfa-b21b80cc33f0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.235129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 474/938] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:26 2022] GET /identity/v3/endpoints?service_id=0f1c191e8c52443f86c9fd7cfd414199&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:26.236635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.241304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:26.276801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.277683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.278003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.278281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.292035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.294162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:26.314091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:26.315116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:26.316145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:26.316145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:26.316145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:26.320070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 465/939] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:26.321731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.370544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40099d72-a8c5-4a1f-862a-364120920bb2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.412533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.413661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.414217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.414847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.415926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.417951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.431443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 475/940] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:26 2022] GET /identity/v3/services => generated 1497 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:04:26.449452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305c799-0848-49b5-8925-c9abeccc94e3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.489513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.490135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.490408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.490673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.491379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:26.491691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.493166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.507335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 466/941] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:26.513292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.552045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:26.635636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2357df4b-880d-45ed-b496-b9c3bb70f615 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.672920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.673552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.673836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.674109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.681117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.682566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:26.694114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:26.695075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:26.696330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 476/942] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:26.703155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.726007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:26.806418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cdf960-85c9-49ed-9715-ed7bce6979a3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:26.843377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:26.844394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:26.844897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:26.845388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:26.846282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:26.846790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:26.848445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3cc6d-5d96-4db6-a735-e79c9d3ce72a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:26.861006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 467/943] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:26.867265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:26.969491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:26.978434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914e49-325b-4efd-a304-452d95612ab3 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:27.013946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca006f-be02-4b44-98d9-5ba4cb6b9b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:27.014609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca006f-be02-4b44-98d9-5ba4cb6b9b0e None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:27.014918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca006f-be02-4b44-98d9-5ba4cb6b9b0e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:27.015188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca006f-be02-4b44-98d9-5ba4cb6b9b0e None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/c06aa3d6bf274e19946f35bf9392fce6/roles/d795374e41484e748ed2fc7dc6a51af7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:27.017357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca006f-be02-4b44-98d9-5ba4cb6b9b0e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=c06aa3d6bf274e19946f35bf9392fce6, role_id=d795374e41484e748ed2fc7dc6a51af7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:27.018840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca006f-be02-4b44-98d9-5ba4cb6b9b0e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:27.033245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 477/944] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:26 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/c06aa3d6bf274e19946f35bf9392fce6/roles/d795374e41484e748ed2fc7dc6a51af7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:04:27.447723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab65c-3047-4f74-8794-0918f69e6d08 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:27.448271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab65c-3047-4f74-8794-0918f69e6d08 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:27.448271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420ab65c-3047-4f74-8794-0918f69e6d08 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:27.449871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 468/945] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:27.455915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008b0a-0dec-4d31-8593-70b52c5e6822 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:27.456372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008b0a-0dec-4d31-8593-70b52c5e6822 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:27.456550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008b0a-0dec-4d31-8593-70b52c5e6822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:27.474610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-32008b0a-0dec-4d31-8593-70b52c5e6822 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:27.475802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-32008b0a-0dec-4d31-8593-70b52c5e6822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:27.545984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 478/946] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:27.816330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ab65c-3047-4f74-8794-0918f69e6d08 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:27.899613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:27.900471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4e24-d139-48b0-875b-65c9aa9b9da3 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:27.900756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4e24-d139-48b0-875b-65c9aa9b9da3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:27.901029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a4e24-d139-48b0-875b-65c9aa9b9da3 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:27.902988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 479/947] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:27.908871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:27.909147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:27.909415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:27.922697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420ab65c-3047-4f74-8794-0918f69e6d08 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:27.935621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:27.937496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:27.964236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:27.964855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:27.965136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:27.965407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:27.966067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:27.967628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:27.970929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING keystone.server.flask.common [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 31 12:04:27.990886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.sql.core [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:04:27.990886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 12:04:27.990886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [parameters: {'id': '0ba329647ea64c53915b10c022b1685c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 12:04:27.990886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81686) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ba329647ea64c53915b10c022b1685c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ba329647ea64c53915b10c022b1685c. Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:04:27.998514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 31 12:04:27.999388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application yield resource Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise self.value Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application session.commit() Aug 31 12:04:28.000456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:04:28.001359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:04:28.002268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:04:28.003105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [parameters: {'id': '0ba329647ea64c53915b10c022b1685c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:28.005011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:28.006890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0ba329647ea64c53915b10c022b1685c. Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 469/948] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Aug 31 12:04:27 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:28.009213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:28.048099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 480/949] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:28.124730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf4171-31ce-4197-8a93-7d3c5f6ea86d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:28.164696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:28.165654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.166128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.166581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.169665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:28.176029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:28.179005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:28.193028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:28.193991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:28.194881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.197233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 470/950] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:28.203511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:28.228288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:28.306157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee49488-9ac6-46e2-aeac-97d379301b55 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:28.341260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:28.342146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.342600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.342964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.343627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:28.343740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:28.343922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:28.345433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790c877-c669-41c5-b64d-a5509b6349ab None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:28.366531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 481/951] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:28 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:28.472487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d07a94-0719-4d23-bbdf-9c0a920bbac8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:28.512625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:28.513511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.513971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.514402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.515166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:28.516716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:28.522161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6106-5a04-468c-8998-86487c0d5fb6 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.522757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6106-5a04-468c-8998-86487c0d5fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.522757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e6106-5a04-468c-8998-86487c0d5fb6 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.524094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 482/952] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:28.527645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:28.529019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:28.530374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:28.531882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.532358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.532769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.538608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 471/953] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:28.540156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:28.553420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:28.554828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:28.612366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:28.634955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 483/954] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:28.663799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb626975-b436-45ba-9c6c-cd1ba92e1841 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:28.699422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:28.700052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.700327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.700590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.701218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:28.701516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:28.702874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:28.711069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 472/955] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:28.716875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:28.721922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:28.833369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0a97e-a681-4af8-a0e7-a1bbacc228e9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:28.882592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:28.883205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:28.883484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:28.883753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:28.884412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:28.884710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:28.886090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c096a19-6d4e-449c-8363-2f071569a48b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:28.891072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 484/956] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:28.903582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.048372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf2c66-18b3-4f8b-8d53-4aba2f56e42e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.059700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c048f3-072d-45fe-9d0f-64a8a72e5e08 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.060285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c048f3-072d-45fe-9d0f-64a8a72e5e08 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.060861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c048f3-072d-45fe-9d0f-64a8a72e5e08 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.062715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 485/957] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:29.067627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.067912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.068232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.089461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:29.090027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.090304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.090568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.090854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:29.091141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:29.092087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:29.092554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:29.096328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:29.104158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:29.105553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:29.106453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 473/958] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:29.112278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.170514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:29.179897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 486/959] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:29.225507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcfe8a-9865-4d3d-82cc-6c1cbf1d8b42 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.261606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:29.262227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.262508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.262780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.263418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:29.263722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:29.265734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:29.272320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 474/960] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:29.277758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.380429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390bbf9b-ad18-4a3d-8bdf-c100e005cad6 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.415877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:29.416536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.416814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.417082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.417715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:29.418014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:29.419378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:29.424730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 487/961] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:29.430329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.482253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.493118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:29.554363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314111e-998e-49ff-a019-12ffc250d14e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.556572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:29.599377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:29.600127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.600473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.600816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.601841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:29.604074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:29.605550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d513e93-805d-4ed7-8854-6d4f8e4ce489 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.632188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 475/962] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:29.662326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:29.663328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.663788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.664281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.677694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:29.682931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:29.683989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:29.684858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:29.687338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 488/963] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 31 12:04:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:29.693481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.807156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e0bc1-07b1-431a-839f-69eb38ad3e38 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.816697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:29.847682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:29.848684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:29.849162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:29.849648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:29.850504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:29.851027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:29.852636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:29.861501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 476/964] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:04:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:29.866910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:29.980529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ad10-3848-4763-80a8-3edcc9219190 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:29.998234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:30.019038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:30.019671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.019968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.020246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.031548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:30.033052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:30.048283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:30.049298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:30.050201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:30.050201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:30.050201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:30.054350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 489/965] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:30.055726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:30.168244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11aec5b-f1f9-4316-b3dd-3bab32f836db None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:30.205880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:30.206498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.206770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.207091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.207676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:30.207990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:30.209350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:30.222163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 477/966] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:30.227727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:30.332584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19153dee-c6f6-42cf-9a8b-f91d75ef5024 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:30.368834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:30.369465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.369750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.370023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.378226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:30.379695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ce8b6bcd-6dd8-473d-8f9a-5e341cc248b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:30.391368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:30.393574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 31 12:04:30.395764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:30.399999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 490/967] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:04:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:30.400277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:30.430601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:30.507104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18025a3c-5251-4e6e-b113-abaeb1e0bbf1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:30.526442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c470-ba41-477a-b86e-7e6fa9d698a7 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.526741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c470-ba41-477a-b86e-7e6fa9d698a7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.526995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1853c470-ba41-477a-b86e-7e6fa9d698a7 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.528664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 491/968] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:30.534078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.534363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.534647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.543237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:30.543849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.544150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.544418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.545142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:30.545442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:30.547477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:30.554734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:30.555924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:30.567862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 478/969] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Aug 31 12:04:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:30.576897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:30.583445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:30.644042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 492/970] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:30.684389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:30.696784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd28314e-5636-4f5d-aafa-5a87d2236356 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:30.737461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:30.738081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:30.738365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:30.738638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:30.810415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:30.811959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:30.905278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:30.919538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 479/971] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:30.925967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:30.932047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.047806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86efc38-22e3-41e6-9998-f52184d7ee9c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.048856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b767732a-437b-4be5-9b9f-2f4934f40d91 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.087531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.088281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.088592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.088868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.090753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.091637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.092086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.092494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.093987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.096267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.100833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.102468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.116390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.sql.core [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:04:31.116390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 12:04:31.116390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [parameters: {'user_id': '8a2f59ce055c465788768a0c30d23247', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 12:04:31.116390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81686) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-321b081b-c9cf-48f0-830e-2273627f2d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:31.119012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:31.120237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:31.121201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:31.121201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:31.121201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Aug 31 12:04:31.122855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:04:31.123737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application yield resource Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application next(self.gen) Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.rollback() Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.force_reraise() Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise self.value Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application session.commit() Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 31 12:04:31.125718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._prepare_impl() Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.session.flush() Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._flush(objects) Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application compat.raise_( Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application flush_context.execute() Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rec.execute(self) Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 31 12:04:31.128234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 31 12:04:31.130382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result = self._query(query) Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application conn.query(q) Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application result.read() Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 31 12:04:31.132255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [parameters: {'user_id': '8a2f59ce055c465788768a0c30d23247', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:31.134055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 31 12:04:31.135157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 31 12:04:31.136463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 31 12:04:31.136463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 31 12:04:31.136463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 31 12:04:31.136463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 31 12:04:31.136463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 31 12:04:31.136463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.136944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 493/972] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:31.136944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353266d-0bd2-4695-9253-71358b97afda None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.136944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353266d-0bd2-4695-9253-71358b97afda None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.136944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353266d-0bd2-4695-9253-71358b97afda None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.136944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 494/973] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:31.137651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 480/974] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Aug 31 12:04:30 2022] POST /identity/v3/users => generated 160 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:31.137651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.137927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353266d-0bd2-4695-9253-71358b97afda None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.149291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:31.191967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:31.248510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353266d-0bd2-4695-9253-71358b97afda None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.251559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd490d62-0519-4eb2-8cf7-23736c502a05 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.286858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.287106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.287576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.287683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.287863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.289333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.289459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.289539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.289539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:31.289539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.290535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267eb7cb-7793-4c6e-b23e-ac9a6fbc6a34 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.297098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.298798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.307615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 495/975] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:31.307615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.307615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.307615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:31.314530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:31.315552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 31 12:04:31.316855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.320534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 481/976] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:31.321454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.325775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:31.326468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:31.396057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:31.401739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 496/977] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:31.402584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.453100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e3a92-f842-4b25-9f2b-143505dbf352 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.464756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:31.492513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.493420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.493770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.494116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.503235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.505775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:31.520972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:31.522479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:31.523728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:31.527408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 482/978] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:31.528424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.548100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247fed0-7dbc-447c-bb8c-ce0a379c79d0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.598096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.600096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.600620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.601049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.602586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:31.603070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.605255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.649859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543dcd68-fa7c-4ceb-b85f-fa18232ce60b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.656163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 497/979] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Aug 31 12:04:31 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:31.672581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.698410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.699039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.699320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.699593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.700337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:31.700645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.702627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0813fb4-f773-4d89-b5f9-d9be24041db3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.719839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 483/980] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:31.721318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bdd4d-e390-4597-bef5-8cf4163dbe4a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.721610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bdd4d-e390-4597-bef5-8cf4163dbe4a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.721881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bdd4d-e390-4597-bef5-8cf4163dbe4a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.723314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 484/981] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:31.726146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bdd4d-e390-4597-bef5-8cf4163dbe4a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:31.748575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:31.762751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:31.794115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40b96d-7f4d-44eb-8651-c0ce9e3d43fd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.835218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6030-d1b1-4dd0-a2af-4f4294cb55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.836277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6030-d1b1-4dd0-a2af-4f4294cb55a8 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.836277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6030-d1b1-4dd0-a2af-4f4294cb55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.836462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6030-d1b1-4dd0-a2af-4f4294cb55a8 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.837044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc6030-d1b1-4dd0-a2af-4f4294cb55a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.838424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc6030-d1b1-4dd0-a2af-4f4294cb55a8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.850055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bdd4d-e390-4597-bef5-8cf4163dbe4a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:31.854572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 498/982] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:31 2022] POST /identity/v3/services => generated 242 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:04:31.856073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.856296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.856567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.877330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:31.878648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:31.904712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:31.906205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:31.906205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:31.906205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:31.906577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] RBAC: Adding query filter params (role.id=d795374e41484e748ed2fc7dc6a51af7, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=c06aa3d6bf274e19946f35bf9392fce6) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:31.906891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:31.908493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:31.915634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 485/983] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:31 2022] GET /identity/v3/role_assignments?user.id=c06aa3d6bf274e19946f35bf9392fce6&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=d795374e41484e748ed2fc7dc6a51af7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:31.982135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 499/984] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:32.249337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:32.341649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:32.352514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcac46f-7f97-44e1-bb6d-184dbe7acf15 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:32.386969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:32.387605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:32.387894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:32.388176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:32.388748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:32.390158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:32.398989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:32.400289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:32.401437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:32.402673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 486/985] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:32.406005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:32.455103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:32.508213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a809b35-5c29-4818-aa0e-48e015dc6836 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:32.541480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:32.542088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:32.542374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:32.542644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:32.543270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:32.543571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:32.545020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:32.550576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 500/986] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:32.556021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:32.654846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e82f6e-a79c-4420-b068-9d80458214ee None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:32.688535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:32.689181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:32.689464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:32.689715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:32.690333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:32.690633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:32.692004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:32.697400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 487/987] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:32.703508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:32.801134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de38a-1c93-4110-90b9-a9f7c14872a6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:32.814405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:32.837119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:32.837865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:32.838243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:32.838613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:32.839416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] RBAC: Adding query filter params (interface=admin, service_id=0f1c191e8c52443f86c9fd7cfd414199, region_id=RegionOne) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:32.839821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:32.841306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476f438-2d99-4463-a3dc-99f2637642e4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:32.846606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 501/988] 10.222.0.48 () {56 vars in 1249 bytes} [Wed Aug 31 12:04:32 2022] GET /identity/v3/endpoints?service_id=0f1c191e8c52443f86c9fd7cfd414199&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:32.852605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:32.872070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:32.967133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0b0ce-c603-4eab-ad10-de21cd3ce76a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:33.004450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da54bb9-1fc8-40ee-ac19-a4c7bf931080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:33.005126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54bb9-1fc8-40ee-ac19-a4c7bf931080 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:33.005405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54bb9-1fc8-40ee-ac19-a4c7bf931080 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:33.005758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da54bb9-1fc8-40ee-ac19-a4c7bf931080 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:33.006405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54bb9-1fc8-40ee-ac19-a4c7bf931080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:33.008032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da54bb9-1fc8-40ee-ac19-a4c7bf931080 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:33.024309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 488/989] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:32 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:04:33.849688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fdf18-94f5-4a2f-bab2-9c3ae3059131 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:33.850276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fdf18-94f5-4a2f-bab2-9c3ae3059131 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:33.850276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fdf18-94f5-4a2f-bab2-9c3ae3059131 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:33.851740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 502/990] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:33.856823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:33.857273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:33.857561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:33.876883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:33.878603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:33.879748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4254-e7af-4753-8555-a9e8246e2c04 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:33.880062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4254-e7af-4753-8555-a9e8246e2c04 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:33.880345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b4254-e7af-4753-8555-a9e8246e2c04 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:33.882748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 503/991] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:33.886924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:33.887211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:33.887487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:33.905877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:33.907051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:33.963420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 489/992] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:33.980606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 504/993] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:34.233012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.247658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:34.252839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.341449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22669dbf-e88e-48e1-a9ca-246d44100c2a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.361306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894291-e4b0-48fc-9b0e-d169057abd29 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.369393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:34.378092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.378727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.379003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.379270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.379847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.381249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:34.390737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:34.391938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:34.393012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 490/994] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:34.397606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.402300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.403002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.403355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.403690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] PATH_INFO: `/v3/services/image` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.404382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.405854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:34.414897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:34.416144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:34.417201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:34.418042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 505/995] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:34.423131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.482892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:34.509253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532469a9-d315-447b-8aee-9838fc7a1650 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.531794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d302cc5b-d9ed-46ac-881b-e9e4c2e667be None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.545258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.546627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.546857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.547196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.547972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:34.548290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.549739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.555997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 491/996] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:34.560914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.568282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.568901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.569172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.569440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.570066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:34.570366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.572008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.577224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 506/997] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:34.582924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.620717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:34.666153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177edd1-c84c-45c7-a7e3-97f715c97deb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.693497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929db7f-3e90-42c8-8787-b8875deb5ce4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.702434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.703123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.703480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.703824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.704486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:34.704791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.706163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.715782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 492/998] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:34.716744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.720577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:34.736835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.737442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.737722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.737991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.738617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] RBAC: Adding query filter params (type=image) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:34.738916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.740322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.745067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 507/999] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:34.835997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57935cdd-ce16-4edd-b950-81d1de91947c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:34.872166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:34.872814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.873050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.873316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.874574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] RBAC: Adding query filter params (interface=public, service_id=1f405ed6d0ce4e64914faac5b25213c3, region_id=RegionOne) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:34.874882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:34.876304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574ecdc-d75c-42f2-8b42-2a1c483fac06 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:34.882463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 493/1000] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/endpoints?service_id=1f405ed6d0ce4e64914faac5b25213c3&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:34.887516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:34.942674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d17fd-92b1-4d48-afe0-0b3a42b24cdc None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.943264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d17fd-92b1-4d48-afe0-0b3a42b24cdc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.943553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d17fd-92b1-4d48-afe0-0b3a42b24cdc None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.944938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 494/1001] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:34.950577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:34.950863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:34.951138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:34.970286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:34.971462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:34.993882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:35.000279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90811677-3a26-40f5-aa68-dd1ebf2f3bac None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:35.035612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:35.036301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:35.036630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:35.036951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:35.037536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:35.038328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:35.040024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:35.044094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 495/1002] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:35.059984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 508/1003] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:34 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:04:35.319489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:35.419390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6736d1-e84c-47c8-b8f5-873e0aef299d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:35.452808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:35.453500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:35.453711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:35.453974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:35.454542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:35.455972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:35.464532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:35.465509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 31 12:04:35.466382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:35.468299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 496/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Aug 31 12:04:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:35.472591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:35.573460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f29d05f-5a1c-4ba7-bd92-dd01b04089d0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:35.607203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:35.607807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:35.608145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:35.608418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:35.609040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:35.609337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:35.610702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:35.615572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 509/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:35.621107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:35.682887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:35.725462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25c885-a99c-42c1-b028-b3fed460d948 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:35.758785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:35.759393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:35.759671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:35.759974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:35.760586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:35.760885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:35.762246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f4856-70cf-44ba-9198-5e4e2c8c23dd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:35.773845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 497/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Aug 31 12:04:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:35.774031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:35.801257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:35.877970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd995d-fc76-4b23-944e-b2fb3e180b3a None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:35.910924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e56f-d985-4334-874a-d65d79c7dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:35.911529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e56f-d985-4334-874a-d65d79c7dcad None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:35.911794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e56f-d985-4334-874a-d65d79c7dcad None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:35.912094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e56f-d985-4334-874a-d65d79c7dcad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:35.912764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9e56f-d985-4334-874a-d65d79c7dcad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:35.914122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9e56f-d985-4334-874a-d65d79c7dcad None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:35.939975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 510/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:36.666565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa3fe-a1be-486a-9d62-afcd5b05a2f9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:36.667091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa3fe-a1be-486a-9d62-afcd5b05a2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:36.667091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa3fe-a1be-486a-9d62-afcd5b05a2f9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:36.668512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 498/1008] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:36.674074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97acb-6d50-48cb-a9ac-dc357bc460fa None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:36.674363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97acb-6d50-48cb-a9ac-dc357bc460fa None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:36.674638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d97acb-6d50-48cb-a9ac-dc357bc460fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:36.693068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f2d97acb-6d50-48cb-a9ac-dc357bc460fa None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:36.694291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f2d97acb-6d50-48cb-a9ac-dc357bc460fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:36.766616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 511/1009] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:36.947205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8acef-114a-4bd0-b0d3-a39e7e59aab1 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:36.947407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8acef-114a-4bd0-b0d3-a39e7e59aab1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:36.947840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8acef-114a-4bd0-b0d3-a39e7e59aab1 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:36.949358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 499/1010] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:36.960014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:36.960816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:36.961298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:36.980187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:36.981648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:36.989746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:37.038099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8acef-114a-4bd0-b0d3-a39e7e59aab1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:37.064423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 512/1011] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:36 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:37.151484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8acef-114a-4bd0-b0d3-a39e7e59aab1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:37.177393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:37.188065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:37.188738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.189030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.189303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.189984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:37.191474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:37.212072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 500/1012] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:37 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:37.342058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:37.444082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc857a28-842d-4940-9291-e49aa506e4f0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:37.485439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:37.486436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.486942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.487422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.488236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:37.489821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:37.499516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:37.500698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:37.501574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 513/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:37.507479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:37.610169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ed1b6c-6654-4ddc-b06a-d4b5a47244c8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:37.644134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:37.644748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.645029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.645303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.645932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:37.646237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:37.647603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:37.652682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 501/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:37.658407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:37.661257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:37.764834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df19f0-1e04-47bf-a99a-dd0f0486f06b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:37.798330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:37.798928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.799208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.799477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.800129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:37.800431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:37.801798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba95185-bd58-47f8-9eb5-e18c9c032481 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:37.811193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 514/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Aug 31 12:04:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:37.813390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:37.840994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b84cb-7c33-4a38-8823-fde8fd1e50f1 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.841330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b84cb-7c33-4a38-8823-fde8fd1e50f1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.841546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3b84cb-7c33-4a38-8823-fde8fd1e50f1 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.843643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 515/1016] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:37.848289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.848576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.848854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.866758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:37.868488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:37.869688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:37.925523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064a992-44bd-47d0-a2e6-f9b05e9d1ea0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:37.933435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:37.943986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 516/1017] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:37 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:37.966598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:37.967201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:37.968031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:37.968302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:37.968965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:37.970312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:37.995986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 502/1018] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:04:38.210778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:38.315130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ad4e5-2d78-426c-ad2c-fe246978eb36 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:38.356348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce470408-c7a1-486a-af4f-86904d7bd559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:38.357041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470408-c7a1-486a-af4f-86904d7bd559 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:38.357313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470408-c7a1-486a-af4f-86904d7bd559 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:38.357574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce470408-c7a1-486a-af4f-86904d7bd559 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:38.359302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce470408-c7a1-486a-af4f-86904d7bd559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:38.360775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce470408-c7a1-486a-af4f-86904d7bd559 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:38.363981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 517/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:38.368076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:38.470158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060faab1-aef1-4dd4-8678-3ba41d02ffbe None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:38.476836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:38.505851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a5c0da-2070-49bb-96b8-b69946b8b0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:38.506456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5c0da-2070-49bb-96b8-b69946b8b0a1 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:38.506729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5c0da-2070-49bb-96b8-b69946b8b0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:38.506996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a5c0da-2070-49bb-96b8-b69946b8b0a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:38.507632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5c0da-2070-49bb-96b8-b69946b8b0a1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:38.509112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a5c0da-2070-49bb-96b8-b69946b8b0a1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:38.537005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 503/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:04:38 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:04:39.190357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ac253-ccbc-4095-98e2-ec36255f47ca None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:39.190690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ac253-ccbc-4095-98e2-ec36255f47ca None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:39.190899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ac253-ccbc-4095-98e2-ec36255f47ca None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:39.192320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 518/1021] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:39.197532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:39.197966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:39.198059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:39.216864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:39.218517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:39.286025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 504/1022] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:39.563691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ac253-ccbc-4095-98e2-ec36255f47ca None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:39.630310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:39.674569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ac253-ccbc-4095-98e2-ec36255f47ca None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:39.710845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:39.711483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:39.711762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:39.712058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] PATH_INFO: `/v3/services/image` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:39.712639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:39.714004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:39.723218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:39.724222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:39.725058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 519/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Aug 31 12:04:39 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:39.731879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:39.818909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:39.832967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08eac9-75e6-47e6-869d-7ca157ade4aa None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:39.868366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:39.868988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:39.869267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:39.869692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:39.870329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] RBAC: Adding query filter params (name=image) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:39.870634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:39.872028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb198806-8145-43d4-b29d-8355bfa37c71 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:39.882656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 505/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:39.883597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:39.986568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d083fe-d5b2-4c46-9b96-ff009b32c3c2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:40.010060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:40.021768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:40.022623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.022733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.023008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.023649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] RBAC: Adding query filter params (type=image) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:40.023995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:40.024159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab661-f61a-4b1e-b8cf-418b1b67c520 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.024401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab661-f61a-4b1e-b8cf-418b1b67c520 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.024674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ab661-f61a-4b1e-b8cf-418b1b67c520 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.025359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:40.026151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 506/1025] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:40.035503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 520/1026] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:40.035650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.035650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.035650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.036343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:40.049885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:40.051073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:40.124396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 507/1027] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:40.147465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158da406-3a4f-4e4c-9f73-cff8dbe91465 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:40.182162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:40.182767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.183049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.183324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.184168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] RBAC: Adding query filter params (interface=public, service_id=f478c5bba2aa4639bf7fea0eebe86172, region_id=RegionOne) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:40.184480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:40.185902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:40.196854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 521/1028] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/endpoints?service_id=f478c5bba2aa4639bf7fea0eebe86172&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:40.197770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:40.284205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:40.302991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40269387-8a4c-43c8-a536-1090bb3da1a2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:40.338064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7f93ee-8707-4e55-823a-1529a40c66a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:40.338681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f93ee-8707-4e55-823a-1529a40c66a9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.338964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f93ee-8707-4e55-823a-1529a40c66a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.339241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7f93ee-8707-4e55-823a-1529a40c66a9 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.339850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f93ee-8707-4e55-823a-1529a40c66a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:40.341273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7f93ee-8707-4e55-823a-1529a40c66a9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:40.356227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 508/1029] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:04:40.392417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:40.452737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:40.507049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e4bd8-ea79-4243-add7-bba92343d71f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:40.532658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3c64-cc3c-4eb4-9867-152fd391fd86 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.532966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3c64-cc3c-4eb4-9867-152fd391fd86 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.533214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3c64-cc3c-4eb4-9867-152fd391fd86 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.534564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 509/1030] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:40.539435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.539719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.540017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.542898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:40.543715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.544026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.544304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.556003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:40.558728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:40.559912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:40.560864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:40.562475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:40.563479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 522/1031] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:40.568521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:40.635389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 510/1032] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:40.676244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20573a98-de77-4b6e-add3-3b02c18c02ef None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:40.689914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:40.712054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:40.712663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.712944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.713217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.713877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:40.714180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:40.715557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:40.725045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 523/1033] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:40.730677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:40.811205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:40.835670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6308503b-54dd-46c4-8254-8282952cae79 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:40.869471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:40.870101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:40.870378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:40.870649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:40.881330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:40.882776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:40.897787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:40.898832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:40.899733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:40.899733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:40.899733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:40.903697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 511/1034] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:40.905008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:40.909300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:41.015704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7c46d-d1c3-4b3a-b67f-f25f7c84d1c3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.015965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11e334-c82b-4561-b79b-c39565789f88 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.042147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:41.050868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.051267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.051506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.051787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.051890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.052102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.052251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.052489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.053230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.053328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:41.053610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.054667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.054960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.056560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 512/1035] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:41.062269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:41.077729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 524/1036] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:41.079083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:41.120992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:41.165163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522037-c8b3-403f-963e-eaee8dec9582 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.190471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b2e31-3154-4bc2-8777-01346a24563d None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.201506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.202683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.202928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.203200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.203921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.205393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.228185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 513/1037] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:04:41 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:04:41.228460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.229061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.229341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.229609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.247822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.249917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:41.262760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:41.263820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:41.264877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:41.268326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 525/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:04:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:41.269836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:41.331173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:41.394858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f9fd2-5617-47ec-8910-d9faa0ef13a9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.431530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.432587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.432871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.433141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.433907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:41.434212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.435768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.456846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 514/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:04:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:41.462551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:41.556185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:41.565080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb046854-552f-4a0f-ba9d-e9c7debf8679 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.598709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.599403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.599759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.600127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.667472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.669066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.761162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:41.774321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 526/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:41.775632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:41.876115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21794e2b-1b7e-4944-ad20-9e78e09699af None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:41.886848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:41.912141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:41.913079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:41.913508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:41.913929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:41.928459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:41.930047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:41.947096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:41.948362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:41.949491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:41.949491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:41.949491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:41.950684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 515/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:41.956791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:42.058267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922f35f-2f85-4326-8806-2aa8f65b8d3b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:42.093075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:42.093877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.094327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.094750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.095528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:42.096063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:42.097581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d980175-be80-49bc-afbe-986b3fea9ccc None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:42.109388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 527/1042] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:42.114753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:42.217920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25171916-b81c-45b6-8578-5b92ec4dddba None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:42.251738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:42.252412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.252692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.252966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.257491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962167-7f1b-422d-87a0-b8be1755dbcb None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.258044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962167-7f1b-422d-87a0-b8be1755dbcb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.258520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd962167-7f1b-422d-87a0-b8be1755dbcb None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.260136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 528/1043] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:42.261274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:42.262730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:42.265107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.265599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.265725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:42.274912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:42.275867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:42.276906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:42.282045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 516/1044] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:42.282806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:42.285654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:42.286820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:42.308135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:42.343775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:42.362907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 529/1045] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:42.389850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8e2b5-f907-4a89-ad9d-96d4ca318b09 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:42.425058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:42.425668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.425945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.426216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.426904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:42.427215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:42.428680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:42.441758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 517/1046] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:42.447856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:42.545571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057988a7-359b-4cd3-94f0-54ca903e79fa None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:42.578952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:42.579529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.579811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.580108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.580818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] RBAC: Adding query filter params (role.id=d795374e41484e748ed2fc7dc6a51af7, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=e1da264bfb8e41589f88d2e84528d92d) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:42.581122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:42.582537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:42.596238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 530/1047] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:42 2022] GET /identity/v3/role_assignments?user.id=e1da264bfb8e41589f88d2e84528d92d&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=d795374e41484e748ed2fc7dc6a51af7 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:42.635646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:42.726713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:42.747206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647dd06-b89e-489b-af02-64ed93ec9a13 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:42.782144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:42.782776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.783052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.783323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.783901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:42.785292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:42.794094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:42.795089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:42.796074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 518/1048] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Aug 31 12:04:42 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:42.801043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:42.851519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:42.904568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266e937-699e-4a3c-acc0-fb1680d6561e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:42.943742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:42.944445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:42.944732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:42.945001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:42.945627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:42.946183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:42.947539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:42.957640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 531/1049] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:42.958798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:43.063203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcecedf-0e42-493b-92a3-41eb47299ce3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:43.097392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:43.097998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:43.098276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:43.098547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:43.099168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] RBAC: Adding query filter params (type=image) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:43.099475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:43.100856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af6ede-7b81-4f39-be13-c16711f2890e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:43.110457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 519/1050] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:43.111373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:43.212223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcf730-daa2-4cf0-b46d-00e98fb873f2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:43.224855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:43.231941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071d733-127f-4f0b-b734-6d7f2d89ef5b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:43.232441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071d733-127f-4f0b-b734-6d7f2d89ef5b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:43.232549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071d733-127f-4f0b-b734-6d7f2d89ef5b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:43.234109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 520/1051] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:43.239899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:43.240239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:43.240536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:43.249608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:43.250209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:43.250485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:43.250756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:43.251422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:43.252832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:43.259824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:43.261064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:43.266538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:43.276593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 532/1052] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:04:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:04:43.355224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 521/1053] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:43.626894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:43.731441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2592be7-44ab-4c61-a1f1-925ce8e6f645 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:43.766359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:43.766994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:43.767277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:43.767553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:43.777593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:43.783441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:43.784616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:43.785482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:43.788269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 533/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:43.790602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:43.892158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816b63e-6a81-4a00-a6f4-4258dc0848b3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:43.929624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:43.930230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:43.930509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:43.930779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:43.931446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:43.931739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:43.933137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:43.935804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:43.943662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 522/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:43.949616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:43.983196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:44.057346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73428e-8d00-4f3c-b5fc-525e6623421e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:44.091686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:44.092368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:44.092650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:44.092925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] PATH_INFO: `/v3/users/6d7097789cb94571a8c25566b19feed7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:44.106038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] RBAC: Authorizing `identity:get_user(user_id=6d7097789cb94571a8c25566b19feed7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:44.107508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:44.109338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 534/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:43 2022] GET /identity/v3/users/6d7097789cb94571a8c25566b19feed7 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:44.115172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:44.217894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7d7da-0395-44c9-a8ed-b90b3e24c956 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:44.250940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a7058-efbd-4e8f-867a-768df0eac045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:44.251588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a7058-efbd-4e8f-867a-768df0eac045 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:44.251825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a7058-efbd-4e8f-867a-768df0eac045 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:44.252121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a7058-efbd-4e8f-867a-768df0eac045 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:44.320347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:44.325021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a7058-efbd-4e8f-867a-768df0eac045 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:44.327045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a7058-efbd-4e8f-867a-768df0eac045 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:44.434132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 523/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:44.435730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:44.464272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567945-6158-4939-9a35-c5695e44f997 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:44.464561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567945-6158-4939-9a35-c5695e44f997 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:44.464815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0567945-6158-4939-9a35-c5695e44f997 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:44.466280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 524/1058] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:44.470863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:44.471085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:44.471353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:44.489563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:44.490731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:44.530866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:44.543852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bcf26-3bb9-46c0-9a5b-49ab83ca2bde None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:44.560768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 525/1059] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:44.579751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:44.580393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:44.580671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:44.580935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:44.582032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] RBAC: Authorizing `identity:get_project(project_id=0729e05fd3fb4a69b4a85e19dacd208a)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:44.583450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:44.585246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 535/1060] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:04:44 2022] GET /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:44.591032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:44.621563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:44.695629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b59e90-a8b1-4b60-91ba-91896deee783 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:44.729108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:44.729694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:44.729967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:44.730254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:44.730974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a, user.id=6d7097789cb94571a8c25566b19feed7) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:44.731277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:44.732749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:44.744205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 526/1061] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:44 2022] GET /identity/v3/role_assignments?user.id=6d7097789cb94571a8c25566b19feed7&scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:44.839239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:44.970527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95798bd7-b25d-474b-956b-9ad6992ce624 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.008048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.008601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.008876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.009143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.019678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:45.024558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:45.025490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:45.026355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 536/1062] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 31 12:04:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:45.031766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.125468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:45.136279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8292b-a284-4f78-b030-46f14bd95633 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.172377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.172994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.173273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.173543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.174207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:45.174510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:45.175867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d6837-d81b-4fd2-9adf-dc14894244c3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:45.190241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 527/1063] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:45.191410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.207821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:45.253031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826592-ff8e-4f43-af79-c11952bf41f9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.253606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826592-ff8e-4f43-af79-c11952bf41f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.253606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b826592-ff8e-4f43-af79-c11952bf41f9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.254926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 528/1064] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:45.259896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.260168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.260447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.278823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:45.280304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:45.298419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cc23e4-7781-4173-85d6-beebf7aee631 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.336886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.338141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.338861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.339724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.350385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 529/1065] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:45.354000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:45.355703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:45.370969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:45.371931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:45.372870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:45.372870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:45.372870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:45.373767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 537/1066] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:45.379394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.472271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:45.490589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce586339-421e-424f-a32c-223ffbf0d3cc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.525098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.525636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.525915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.526187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.526823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:45.527125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:45.528556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:45.540476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 530/1067] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:45.546499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.616269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:45.622203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.656183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5d7134-d800-46c6-b094-8149758f7201 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.696665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.697300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.697577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.697847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] PATH_INFO: `/v3/users/nova` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.705817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:45.707253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:45.718876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:45.720072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:45.721237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 538/1068] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:45.726412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.730349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9bd6ef-c095-4c31-b926-d96c9dd993c4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.765373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.766096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.766382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.766643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.781584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:45.840939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:45.842404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:45.844599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55d34-3146-46d3-b69e-099251952cde None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:45.873211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:45.885009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:45.885834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:45.886385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:45.886808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:45.887776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:45.888270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:45.890494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:45.911021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 539/1069] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:45.916741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.942940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 531/1070] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:04:45.949063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:45.997080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:46.028986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9626fd6-7bec-4273-a2e6-858e82f6f688 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.052983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b6a7c-71db-4544-bddb-df099e46bbce None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.063506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.064153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.064435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.064709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.075118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.077120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.090527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.091402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:46.091641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:46.093163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:46.094703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:46.094703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:46.094703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:46.094703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 540/1071] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:46.094941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.094941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.099126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:46.106096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.107527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:46.122197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:46.123165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:46.124676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:46.124676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:46.124676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:46.124676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 532/1072] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:46.129592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:46.140948 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:46.214912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed629b-449b-415a-b4ce-0e3f95714ee6 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.231418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:46.237660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c54ec3-2bc8-4234-852d-1dc6700bcf51 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.251862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.252639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.252784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.253020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.253650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:46.253947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.255363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.272564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 541/1073] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:46.273794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:46.278879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.279531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.279808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.280115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.280757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:46.281123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.282518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.294998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 533/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:46.392967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:46.401130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c724b50-67de-45c6-a7cc-1b5e975ebb1a None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.442063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.442695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.442974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.443235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.450271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.452325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:46.463835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:46.464774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:46.465674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 542/1075] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:46.472572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:46.581779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca40b83-d84a-4f6f-a379-4ec362764754 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.616974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.617589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.617869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.618142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.618839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:46.619146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.620606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4314e0e-020c-4268-be9e-a45a89e6079e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.632326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 534/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:46.638520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:46.656294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720bf77-8478-44cb-b3ac-53f8a441854a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.656506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720bf77-8478-44cb-b3ac-53f8a441854a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.656784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720bf77-8478-44cb-b3ac-53f8a441854a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.658194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 535/1077] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:04:46.664133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.664418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.664692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.684052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:46.685370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:46.697295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:46.744154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1c33b-b5bd-4779-a98d-bc417912720f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:46.757537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 536/1078] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:46.778218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:46.778870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:46.779146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:46.779438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/e1da264bfb8e41589f88d2e84528d92d/roles/d795374e41484e748ed2fc7dc6a51af7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:46.782117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=e1da264bfb8e41589f88d2e84528d92d, role_id=d795374e41484e748ed2fc7dc6a51af7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:46.783546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:46.796094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 543/1079] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:46 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/e1da264bfb8e41589f88d2e84528d92d/roles/d795374e41484e748ed2fc7dc6a51af7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:04:47.022068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:47.118715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fd4f3-8ec4-4455-8026-78cde1e98d21 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:47.152050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:47.152737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:47.153064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:47.153362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:47.164212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:47.169343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:47.170846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:47.171752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 537/1080] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:47.177036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:47.195062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:47.275570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a318bf-c05c-4225-95cd-e4326c5f18e2 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:47.308378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:47.308972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:47.309247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:47.309514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:47.310163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:47.310459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:47.311847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:47.320131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 544/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:47.326085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:47.335791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:47.427379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e60b64e-bdc6-4b3e-9612-1f70d933a299 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:47.470094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:47.470712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:47.470988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:47.471259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] PATH_INFO: `/v3/users/6d7097789cb94571a8c25566b19feed7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:47.472409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7097789cb94571a8c25566b19feed7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:47.473836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:47.475510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 538/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:47 2022] GET /identity/v3/users/6d7097789cb94571a8c25566b19feed7 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:47.481308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:47.556900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:47.578555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0dcc42-af21-4dac-9fed-2ebadb4b6672 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:47.611293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa1eab-f2e9-4cc0-9418-602b0175da48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:47.611909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa1eab-f2e9-4cc0-9418-602b0175da48 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:47.612207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa1eab-f2e9-4cc0-9418-602b0175da48 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:47.612477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa1eab-f2e9-4cc0-9418-602b0175da48 None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:47.613576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa1eab-f2e9-4cc0-9418-602b0175da48 None admin] RBAC: Authorizing `identity:get_project(project_id=0729e05fd3fb4a69b4a85e19dacd208a)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:47.614991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa1eab-f2e9-4cc0-9418-602b0175da48 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:47.616625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 545/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:04:47 2022] GET /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:47.622419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:47.694706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:47.720282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa38f67-013d-4453-a492-4bbcb73b9b49 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:47.753724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf299f81-08db-4554-b45a-1f57311e6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:47.754383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf299f81-08db-4554-b45a-1f57311e6881 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:47.754662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf299f81-08db-4554-b45a-1f57311e6881 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:47.754939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf299f81-08db-4554-b45a-1f57311e6881 None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a/users/6d7097789cb94571a8c25566b19feed7/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:47.756872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf299f81-08db-4554-b45a-1f57311e6881 None admin] RBAC: Authorizing `identity:create_grant(project_id=0729e05fd3fb4a69b4a85e19dacd208a, user_id=6d7097789cb94571a8c25566b19feed7, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:47.758298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf299f81-08db-4554-b45a-1f57311e6881 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:47.771680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 539/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:47 2022] PUT /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a/users/6d7097789cb94571a8c25566b19feed7/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:04:48.682588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab52fc9-b672-46f0-ba80-3864783026a4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:48.683115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab52fc9-b672-46f0-ba80-3864783026a4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:48.683115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab52fc9-b672-46f0-ba80-3864783026a4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:48.684516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 546/1085] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:48.690306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:48.690709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:48.690858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:48.709492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:48.710664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:48.777546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 540/1086] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:49.046058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab52fc9-b672-46f0-ba80-3864783026a4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:49.147509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab52fc9-b672-46f0-ba80-3864783026a4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:49.181724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:49.182352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.182634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.182909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.192961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:49.197998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:49.199108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 31 12:04:49.200276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:49.204160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 547/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Aug 31 12:04:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:49.205165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:49.264716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:49.302962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6b083b-731d-46c1-9265-55c3d868d081 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:49.335141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:49.335747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.336059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.336321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.336974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:49.337270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:49.338620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:49.347054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 541/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:04:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:49.352735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:49.363481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:49.453794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1d2ca-cf38-450f-a858-2ec658686de9 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:49.498302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:49.498930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.499204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.499467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.509469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:49.510916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-fda5347b-ee1b-4649-92df-695d7ee748d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:49.526042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:49.526989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:49.528483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:49.528483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:49.528483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:49.528483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 548/1089] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:04:49.533561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:49.632279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28e092-e217-4130-b018-b645f62900cb None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:49.656728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:49.665819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:49.666451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.666730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.667098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.667746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:49.668081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:49.668963 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26970-0944-44b4-a7fe-821c244ef975 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.669285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26970-0944-44b4-a7fe-821c244ef975 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.669446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:49.669628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26970-0944-44b4-a7fe-821c244ef975 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.671522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 549/1090] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:49.676597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.676883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.677160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.682032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 542/1091] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:49.687995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:49.697280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:49.698467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:49.752106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:49.767986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 550/1092] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:04:49.791533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594edee-99cf-479e-b5f1-594187732aba None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:49.831246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:49.831873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.832233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.832512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.839873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:49.841509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:04:49.853877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:49.854810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:49.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 543/1093] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Aug 31 12:04:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:49.860893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:49.960873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd7cab-d1b9-4f41-9354-59c922688014 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:49.993107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:49.993705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:49.993983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:49.994252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:49.994969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:49.995273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:49.996734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.013528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 551/1094] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Aug 31 12:04:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:50.019735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.036378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.066005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.082266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.119404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fd12a-535b-44e6-b333-3340b17fb4d7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.133894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfced99-5a2a-4f03-b44c-99f000deb387 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.152805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.153409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.153688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.153960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.168417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.169038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.169319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.169593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.181022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:04:50.186074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:50.187060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:04:50.187924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 552/1095] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:50.193302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.221082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.222528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.266418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.292287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab63f8-8f6f-4cd8-a6a6-85817d0bfcd8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.299514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.319338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 544/1096] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:50.325118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.327420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.328056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.328337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.328610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.329273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:50.329575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.330941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.343818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 553/1097] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:50.344791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.421168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051fc28-5e04-427b-898a-f028ca111215 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.440847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eac154d-947d-42f1-b5e0-81d30f0188c7 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.455012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.455640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.455920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.456221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.466011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.467446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.472969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.473579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.473856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.474124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] PATH_INFO: `/v3/users/6d7097789cb94571a8c25566b19feed7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.474255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.475226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] RBAC: Authorizing `identity:get_user(user_id=6d7097789cb94571a8c25566b19feed7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.476660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.478240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 554/1098] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/users/6d7097789cb94571a8c25566b19feed7 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:04:50.483233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:50.484325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:04:50.485933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:04:50.485933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:04:50.485933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:50.485933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 545/1099] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:50.486164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.489787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.519836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.584519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f44ba-319b-4be6-8526-de74e0fe8429 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.588140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3203d7-fb99-454c-88c3-2c271390f179 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.617670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.618265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.618549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.618815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.622101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.622691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.622994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.623267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.623898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:50.624230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.625592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.637958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 546/1100] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:50.643504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.684977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.686463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.699656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.723045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.741275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5aa5fc-60ae-412e-a9f8-7ad268aeb06d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.773611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.774232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.774502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.774767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.782072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.783504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.786503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 555/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:04:50.792400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:04:50.794782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:04:50.801345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 547/1102] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:04:50.802408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.894944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7f578-b41a-40fe-b231-5663e0e6d996 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.898671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fee0c-e06e-4c6a-94d9-4ebdc8bab829 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:50.915096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.928772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.929525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.929872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.930214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.931396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] RBAC: Authorizing `identity:get_project(project_id=0729e05fd3fb4a69b4a85e19dacd208a)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.931929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:50.932548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:50.932821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:50.932916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.933086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:50.933771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:50.934072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:50.934554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 556/1103] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:50.936007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:50.940986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:50.944877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:50.948632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 548/1104] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:50.955122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:51.042441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e3690-07e0-4010-ad16-86d703c5c861 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:51.052174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183421-ba75-4da6-b6fd-3fb6ebcd98a8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:51.075516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:51.076144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:51.076421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:51.076691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:51.077406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a, user.id=6d7097789cb94571a8c25566b19feed7) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:51.077716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:51.079142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7bc6ee-d735-44c4-aaf6-f37611bfad7a None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:51.084826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 557/1105] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/role_assignments?user.id=6d7097789cb94571a8c25566b19feed7&scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:51.086189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:51.086788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:51.087063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:51.087328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:51.088065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] RBAC: Adding query filter params (role.id=d795374e41484e748ed2fc7dc6a51af7, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=e1da264bfb8e41589f88d2e84528d92d) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:51.088370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:51.089799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18390697-cbf6-45e4-9767-71dd0ad8a6e6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:51.096697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 549/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:50 2022] GET /identity/v3/role_assignments?user.id=e1da264bfb8e41589f88d2e84528d92d&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=d795374e41484e748ed2fc7dc6a51af7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:53.022837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5821-1e2e-4b99-b236-79ef73aad2ca None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:53.023303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5821-1e2e-4b99-b236-79ef73aad2ca None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:53.023395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48a5821-1e2e-4b99-b236-79ef73aad2ca None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:53.024746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 558/1107] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:53.030459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:53.030894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:53.030988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:53.049903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:53.051084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:53.085855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:53.118392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:53.400910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a5821-1e2e-4b99-b236-79ef73aad2ca None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:53.467574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:53.508081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48a5821-1e2e-4b99-b236-79ef73aad2ca None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:53.541819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995850b4-46c0-4a6c-9d1c-49d7a7fe01e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:53.542432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995850b4-46c0-4a6c-9d1c-49d7a7fe01e6 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:53.542711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995850b4-46c0-4a6c-9d1c-49d7a7fe01e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:53.542980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995850b4-46c0-4a6c-9d1c-49d7a7fe01e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:53.544096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995850b4-46c0-4a6c-9d1c-49d7a7fe01e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:53.546046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995850b4-46c0-4a6c-9d1c-49d7a7fe01e6 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:53.547595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 559/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:04:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:53.553654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:53.647931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe303156-a724-4d9a-8cd1-2f8dc6abaf4f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:53.681650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe4bf1-95ea-4ed6-a771-7c286655e0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:53.682182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe4bf1-95ea-4ed6-a771-7c286655e0c3 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:53.682458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe4bf1-95ea-4ed6-a771-7c286655e0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:53.682725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe4bf1-95ea-4ed6-a771-7c286655e0c3 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:53.683367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe4bf1-95ea-4ed6-a771-7c286655e0c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:53.684819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe4bf1-95ea-4ed6-a771-7c286655e0c3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:53.707166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 551/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:04:53 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:04:55.614339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c9de-e533-429c-a978-3fafe73b1049 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:55.614867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c9de-e533-429c-a978-3fafe73b1049 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:55.614867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c9de-e533-429c-a978-3fafe73b1049 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:55.616286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 560/1111] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:55.621509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:55.621905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:55.622052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:55.640289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:55.641495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:55.663100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:55.707081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 552/1112] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:55.992700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c9de-e533-429c-a978-3fafe73b1049 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:56.089887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c9de-e533-429c-a978-3fafe73b1049 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:56.123831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:56.124466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:56.124741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:56.125008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] PATH_INFO: `/v3/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:56.126375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] RBAC: Authorizing `identity:get_role(role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:56.127734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:56.129062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 561/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:55 2022] GET /identity/v3/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:56.135919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:56.231884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c6f91b-fe52-4cc7-84ea-1eb1fd3cf223 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:56.264116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:56.264730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:56.265004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:56.265271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] PATH_INFO: `/v3/users/ab9d1a1f2eb846c499b00f6bf9f9d490` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:56.277636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d1a1f2eb846c499b00f6bf9f9d490)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:56.279164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:56.281508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 553/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:56 2022] GET /identity/v3/users/ab9d1a1f2eb846c499b00f6bf9f9d490 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:04:56.287013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:56.290698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:56.381929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c99f3-5e8e-4f4f-b546-c0a0e5b98012 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:56.414553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:56.415144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:56.415419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:56.415684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:56.479267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:56.480748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:56.483936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:56.575170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 562/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:04:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:04:56.581125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:56.599330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:56.677411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e12169a-e320-47db-8ea5-cdbfd340fee1 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:56.710450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d181127-293f-41b2-877c-5102f10c41fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:56.711061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d181127-293f-41b2-877c-5102f10c41fa None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:56.711338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d181127-293f-41b2-877c-5102f10c41fa None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:56.711609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d181127-293f-41b2-877c-5102f10c41fa None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:56.712738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d181127-293f-41b2-877c-5102f10c41fa None admin] RBAC: Authorizing `identity:get_project(project_id=0729e05fd3fb4a69b4a85e19dacd208a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:56.714156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d181127-293f-41b2-877c-5102f10c41fa None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:56.715766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 554/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:04:56 2022] GET /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:56.721937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:56.816302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624722f-28b5-4b0e-b5df-cb01497202b5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:56.818541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:56.850543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:56.851126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:56.851400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:56.851666 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:56.852404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] RBAC: Adding query filter params (role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a, user.id=ab9d1a1f2eb846c499b00f6bf9f9d490) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:04:56.852708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:56.854122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bcb40c-32cb-4794-b08a-e2ffa347f187 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:56.859835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 563/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:04:56 2022] GET /identity/v3/role_assignments?user.id=ab9d1a1f2eb846c499b00f6bf9f9d490&scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:58.722668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49926f05-9756-4476-8eba-08c15285346d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:58.723259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49926f05-9756-4476-8eba-08c15285346d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:58.723259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49926f05-9756-4476-8eba-08c15285346d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:58.724583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 555/1118] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:04:58.729646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:58.730105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:58.730235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:58.747722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:04:58.748931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:04:58.812076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 564/1119] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:04:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:04:59.076795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49926f05-9756-4476-8eba-08c15285346d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:59.171591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:59.187872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49926f05-9756-4476-8eba-08c15285346d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:59.221504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:59.222121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:59.222399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:59.222667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] PATH_INFO: `/v3/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:59.224070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] RBAC: Authorizing `identity:get_role(role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:59.225429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:59.226744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 556/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:59 2022] GET /identity/v3/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:59.232568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:59.323065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:04:59.327654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8db31e-7a8c-4a96-84cf-e0a37d4be3eb None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:59.360066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:59.360679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:59.360953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:59.361221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] PATH_INFO: `/v3/users/ab9d1a1f2eb846c499b00f6bf9f9d490` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:59.362322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d1a1f2eb846c499b00f6bf9f9d490)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:59.363738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:59.365306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 565/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:04:59 2022] GET /identity/v3/users/ab9d1a1f2eb846c499b00f6bf9f9d490 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:59.371018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:59.468632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd457bb-eead-4899-8e30-c272adcc1626 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:59.500316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe37ce-bb21-4cfc-bbb4-376cf5846f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:59.500929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe37ce-bb21-4cfc-bbb4-376cf5846f96 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:59.501203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe37ce-bb21-4cfc-bbb4-376cf5846f96 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:59.501472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe37ce-bb21-4cfc-bbb4-376cf5846f96 None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:59.502569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe37ce-bb21-4cfc-bbb4-376cf5846f96 None admin] RBAC: Authorizing `identity:get_project(project_id=0729e05fd3fb4a69b4a85e19dacd208a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:59.504010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebe37ce-bb21-4cfc-bbb4-376cf5846f96 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:59.505629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 557/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:04:59 2022] GET /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:04:59.511570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:04:59.617984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd01967-da7f-4289-a36a-af789f63f6df None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:04:59.650531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301195fd-12a2-4e53-ae8d-2f5a46ab190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:04:59.651176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301195fd-12a2-4e53-ae8d-2f5a46ab190c None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:04:59.651455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301195fd-12a2-4e53-ae8d-2f5a46ab190c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:04:59.651726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301195fd-12a2-4e53-ae8d-2f5a46ab190c None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a/users/ab9d1a1f2eb846c499b00f6bf9f9d490/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:04:59.653868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301195fd-12a2-4e53-ae8d-2f5a46ab190c None admin] RBAC: Authorizing `identity:create_grant(project_id=0729e05fd3fb4a69b4a85e19dacd208a, user_id=ab9d1a1f2eb846c499b00f6bf9f9d490, role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:04:59.655287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301195fd-12a2-4e53-ae8d-2f5a46ab190c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:04:59.667601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 566/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:04:59 2022] PUT /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a/users/ab9d1a1f2eb846c499b00f6bf9f9d490/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:05:01.526549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa71de9-5020-4063-992d-97a06eda8d1b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:01.527108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa71de9-5020-4063-992d-97a06eda8d1b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:01.527108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa71de9-5020-4063-992d-97a06eda8d1b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:01.528469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 558/1124] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:01.533769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:01.534157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:01.534320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:01.552473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:01.553640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:01.573833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:01.620453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 567/1125] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:01.893945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa71de9-5020-4063-992d-97a06eda8d1b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:01.915279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:01.994763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa71de9-5020-4063-992d-97a06eda8d1b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:02.027731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:02.028384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:02.028662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:02.028956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] PATH_INFO: `/v3/roles/ee5ae647ed9c498189f7d3fd6ea6cc76` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:02.030333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] RBAC: Authorizing `identity:get_role(role_id=ee5ae647ed9c498189f7d3fd6ea6cc76)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:02.031685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:02.033028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 559/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:01 2022] GET /identity/v3/roles/ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:02.038758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:02.134034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f0ac-7c4c-4a22-8b9a-82011e125d59 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:02.167548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:02.168137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:02.168419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:02.168691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] PATH_INFO: `/v3/users/ab9d1a1f2eb846c499b00f6bf9f9d490` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:02.170443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] RBAC: Authorizing `identity:get_user(user_id=ab9d1a1f2eb846c499b00f6bf9f9d490)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:02.171885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:02.173497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 568/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:02 2022] GET /identity/v3/users/ab9d1a1f2eb846c499b00f6bf9f9d490 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:02.179303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:02.263921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:02.275735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de67f6f8-31e9-44f8-ac67-22262bcc80d6 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:02.309015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:02.309629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:02.309904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:02.310727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:02.374295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:02.375718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:02.456645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:02.469453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:05:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:05:02.475393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:02.505277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:02.578367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae98a5-34ed-4b6c-9614-fd31b0f48e89 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:02.610197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a24881-3817-434b-9919-a334abf533a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:02.610811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a24881-3817-434b-9919-a334abf533a8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:02.611089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a24881-3817-434b-9919-a334abf533a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:02.611359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a24881-3817-434b-9919-a334abf533a8 None admin] PATH_INFO: `/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:02.612486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a24881-3817-434b-9919-a334abf533a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0729e05fd3fb4a69b4a85e19dacd208a)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:02.613910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a24881-3817-434b-9919-a334abf533a8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:02.615504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 569/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:02 2022] GET /identity/v3/projects/0729e05fd3fb4a69b4a85e19dacd208a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:02.621687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:02.717865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18797e53-3895-4f67-a14b-d5d37b9344d9 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:02.750213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:02.750805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:02.751085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:02.751358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:02.752105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] RBAC: Adding query filter params (role.id=ee5ae647ed9c498189f7d3fd6ea6cc76, scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a, user.id=ab9d1a1f2eb846c499b00f6bf9f9d490) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:02.752415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:02.753834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e3cee9-407c-4c61-87eb-c3c636ac890a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:02.759408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 561/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:05:02 2022] GET /identity/v3/role_assignments?user.id=ab9d1a1f2eb846c499b00f6bf9f9d490&scope.project.id=0729e05fd3fb4a69b4a85e19dacd208a&role.id=ee5ae647ed9c498189f7d3fd6ea6cc76 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:04.660631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488280c8-3e63-4a5a-9a23-56dc3954f145 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:04.661184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488280c8-3e63-4a5a-9a23-56dc3954f145 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:04.661184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488280c8-3e63-4a5a-9a23-56dc3954f145 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:04.662520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 570/1131] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:04.667638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:04.668154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:04.668256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:04.685845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:04.687027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:04.732128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:04.751145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:05.021410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488280c8-3e63-4a5a-9a23-56dc3954f145 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:05.110240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:05.119878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488280c8-3e63-4a5a-9a23-56dc3954f145 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:05.153069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12603ff9-6e12-4e78-b423-d19d4afc3561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:05.153712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12603ff9-6e12-4e78-b423-d19d4afc3561 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:05.153994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12603ff9-6e12-4e78-b423-d19d4afc3561 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:05.154267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12603ff9-6e12-4e78-b423-d19d4afc3561 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:05.155366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12603ff9-6e12-4e78-b423-d19d4afc3561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:05.156825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12603ff9-6e12-4e78-b423-d19d4afc3561 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:05.158361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 571/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:05:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:05.164255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:05.261839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1893078-f06f-44e2-bdc5-c9d921fe7410 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:05.296158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e6bb30-17f2-4b36-89c3-021d2b3ae5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:05.296756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6bb30-17f2-4b36-89c3-021d2b3ae5c1 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:05.297035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6bb30-17f2-4b36-89c3-021d2b3ae5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:05.297305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e6bb30-17f2-4b36-89c3-021d2b3ae5c1 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:05.297950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6bb30-17f2-4b36-89c3-021d2b3ae5c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:05.299539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e6bb30-17f2-4b36-89c3-021d2b3ae5c1 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:05.326303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 563/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:05:05 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:05:07.224233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac06d20-eac7-49e8-ac64-ac677c12ee2c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:07.224748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac06d20-eac7-49e8-ac64-ac677c12ee2c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:07.224748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac06d20-eac7-49e8-ac64-ac677c12ee2c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:07.226030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 572/1135] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:07.231071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:07.231460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:07.232232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:07.250417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:07.251613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:07.277003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:07.316032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:07.583839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac06d20-eac7-49e8-ac64-ac677c12ee2c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:07.692388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac06d20-eac7-49e8-ac64-ac677c12ee2c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:07.725668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16207a-d4d9-4c1d-9029-54097fdd3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:07.726283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16207a-d4d9-4c1d-9029-54097fdd3313 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:07.726562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16207a-d4d9-4c1d-9029-54097fdd3313 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:07.726829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16207a-d4d9-4c1d-9029-54097fdd3313 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:07.727916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16207a-d4d9-4c1d-9029-54097fdd3313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:07.729371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16207a-d4d9-4c1d-9029-54097fdd3313 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:07.730899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 573/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:05:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:07.736763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:07.831237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae55106-bb8d-4892-860c-f12449ace484 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:07.864534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154c1870-c38e-4c84-a7e4-97293dae8647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:07.865068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1870-c38e-4c84-a7e4-97293dae8647 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:07.865347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1870-c38e-4c84-a7e4-97293dae8647 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:07.865616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154c1870-c38e-4c84-a7e4-97293dae8647 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:07.866266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c1870-c38e-4c84-a7e4-97293dae8647 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:07.867679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154c1870-c38e-4c84-a7e4-97293dae8647 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:07.887787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 565/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:05:07 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:05:09.803728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dba20-6006-4491-912b-eb3ef9942457 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:09.804284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dba20-6006-4491-912b-eb3ef9942457 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:09.804396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909dba20-6006-4491-912b-eb3ef9942457 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:09.805669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 574/1139] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:09.810924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:09.811337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:09.811467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:09.829781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:09.830949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:09.844972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:09.895693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:10.165331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dba20-6006-4491-912b-eb3ef9942457 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:10.193472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:10.266597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909dba20-6006-4491-912b-eb3ef9942457 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:10.299546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:10.300183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:10.300459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:10.300727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:10.310338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:05:10.315066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:10.316341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:05:10.317567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 575/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:10.322339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:10.416260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e84e10-7ded-48d2-bb44-f821a421317c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:10.448667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32818405-137d-4515-b618-5677ea5646da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:10.449256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32818405-137d-4515-b618-5677ea5646da None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:10.449528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32818405-137d-4515-b618-5677ea5646da None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:10.449793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32818405-137d-4515-b618-5677ea5646da None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:10.450520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32818405-137d-4515-b618-5677ea5646da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:10.450822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32818405-137d-4515-b618-5677ea5646da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:10.452196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32818405-137d-4515-b618-5677ea5646da None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:10.459798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 567/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:10.465285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:10.549339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:10.561737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e828c-d3b0-4691-9aba-58df01feaa3f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:10.594048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:10.594656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:10.594938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:10.595215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] PATH_INFO: `/v3/users/6b7a13b716ae41fe869bdc7c6a99d2ff` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:10.608203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] RBAC: Authorizing `identity:get_user(user_id=6b7a13b716ae41fe869bdc7c6a99d2ff)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:10.609647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:10.611215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 576/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:10 2022] GET /identity/v3/users/6b7a13b716ae41fe869bdc7c6a99d2ff => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:10.616884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32818405-137d-4515-b618-5677ea5646da None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:10.632267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:10.716341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32818405-137d-4515-b618-5677ea5646da None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:10.749320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:10.749908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:10.750182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:10.750449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:10.813977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:10.815395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:10.829520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:10.910075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 568/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:05:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:05:10.915898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:11.014517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77a879-1061-4088-9f19-2a8a7b46c536 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:11.047978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e436378-70c5-4ac3-ac3b-eb20324d4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:11.048603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e436378-70c5-4ac3-ac3b-eb20324d4522 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:11.048881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e436378-70c5-4ac3-ac3b-eb20324d4522 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:11.049150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e436378-70c5-4ac3-ac3b-eb20324d4522 None admin] PATH_INFO: `/v3/projects/945eeef0938847fca36dcae7b4adf084` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:11.050248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e436378-70c5-4ac3-ac3b-eb20324d4522 None admin] RBAC: Authorizing `identity:get_project(project_id=945eeef0938847fca36dcae7b4adf084)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:11.051675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e436378-70c5-4ac3-ac3b-eb20324d4522 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:11.053309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 577/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:10 2022] GET /identity/v3/projects/945eeef0938847fca36dcae7b4adf084 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:11.059415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:11.153182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab788a-a7cf-4dce-9c0d-50c94e66bef8 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:11.166010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:11.187021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:11.187605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:11.187880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:11.188172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:11.188884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=945eeef0938847fca36dcae7b4adf084, user.id=6b7a13b716ae41fe869bdc7c6a99d2ff) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:11.189188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:11.190589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f7715-81a3-4e33-ada0-6a01d093b07c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:11.195966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 569/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:05:11 2022] GET /identity/v3/role_assignments?user.id=6b7a13b716ae41fe869bdc7c6a99d2ff&scope.project.id=945eeef0938847fca36dcae7b4adf084&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:13.118803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca98e-1f3f-4702-9607-538619515466 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:13.119333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca98e-1f3f-4702-9607-538619515466 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:13.119333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca98e-1f3f-4702-9607-538619515466 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:13.120696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 578/1147] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:13.126712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:13.127087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:13.127266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:13.146093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:13.147288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:13.214853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 570/1148] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:13.480131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ca98e-1f3f-4702-9607-538619515466 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:13.496506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:13.583367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ca98e-1f3f-4702-9607-538619515466 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:13.618760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:13.619445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:13.619763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:13.620087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:13.631849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:05:13.637345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:13.638434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:05:13.639312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 579/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:05:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:13.644636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:13.738619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e0396-810e-4b9f-8393-85375ee1f056 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:13.751699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:13.781345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:13.781942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:13.782214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:13.782480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:13.783130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:13.783424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:13.784872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:13.792571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 571/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:05:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:13.798361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:13.870648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:13.896040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0ab9-e73b-4d09-a343-2308d8486292 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:13.928079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:13.928705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:13.928987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:13.929258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] PATH_INFO: `/v3/users/6b7a13b716ae41fe869bdc7c6a99d2ff` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:13.930375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] RBAC: Authorizing `identity:get_user(user_id=6b7a13b716ae41fe869bdc7c6a99d2ff)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:13.931799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:13.933403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 580/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:13 2022] GET /identity/v3/users/6b7a13b716ae41fe869bdc7c6a99d2ff => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:13.939578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:14.036184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4656c922-8b2f-45f9-a5bb-ec571ebe45c4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:14.068094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bc140-7fb1-4bf4-a3c5-c60341b75634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:14.068715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc140-7fb1-4bf4-a3c5-c60341b75634 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:14.068998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc140-7fb1-4bf4-a3c5-c60341b75634 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:14.069268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bc140-7fb1-4bf4-a3c5-c60341b75634 None admin] PATH_INFO: `/v3/projects/945eeef0938847fca36dcae7b4adf084` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:14.070643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc140-7fb1-4bf4-a3c5-c60341b75634 None admin] RBAC: Authorizing `identity:get_project(project_id=945eeef0938847fca36dcae7b4adf084)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:14.072085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bc140-7fb1-4bf4-a3c5-c60341b75634 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:14.073697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 572/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:13 2022] GET /identity/v3/projects/945eeef0938847fca36dcae7b4adf084 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:14.079672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:14.176652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2837223-7ea9-4e50-bcc1-226d8df575bf None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:14.217790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a1a6d-7ac4-425e-b693-efd326886c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:14.218732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1a6d-7ac4-425e-b693-efd326886c8d None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:14.219144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1a6d-7ac4-425e-b693-efd326886c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:14.219547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a1a6d-7ac4-425e-b693-efd326886c8d None admin] PATH_INFO: `/v3/projects/945eeef0938847fca36dcae7b4adf084/users/6b7a13b716ae41fe869bdc7c6a99d2ff/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:14.222340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1a6d-7ac4-425e-b693-efd326886c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=945eeef0938847fca36dcae7b4adf084, user_id=6b7a13b716ae41fe869bdc7c6a99d2ff, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:14.224606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a1a6d-7ac4-425e-b693-efd326886c8d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:14.238990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 581/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:05:14 2022] PUT /identity/v3/projects/945eeef0938847fca36dcae7b4adf084/users/6b7a13b716ae41fe869bdc7c6a99d2ff/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:05:16.168430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ce1a-bd6d-4a58-b16a-8d03558fdc63 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:16.169577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ce1a-bd6d-4a58-b16a-8d03558fdc63 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:16.169577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ce1a-bd6d-4a58-b16a-8d03558fdc63 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:16.170959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 573/1154] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:16.176116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:16.176527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:16.176663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:16.182864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:16.196696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:16.197876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:16.261538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 582/1155] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:16.528197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ce1a-bd6d-4a58-b16a-8d03558fdc63 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:16.564167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:16.627125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557ce1a-bd6d-4a58-b16a-8d03558fdc63 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:16.658550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:16.659156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:16.659435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:16.659703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:16.670990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:05:16.675734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:16.676865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:05:16.677774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 574/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:16.682706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:16.778925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12edd21-8c4c-4c2f-87fa-7d2393da1e77 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:16.807148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:16.812455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:16.813049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:16.813330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:16.813603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:16.814258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:16.814561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:16.815925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:16.823970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 583/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:16.830592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:16.928923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:16.935468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e80439-030f-4a7f-8d8d-3a235c5255de None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:16.969059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:16.969686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:16.969964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:16.970232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] PATH_INFO: `/v3/users/6b7a13b716ae41fe869bdc7c6a99d2ff` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:16.971371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] RBAC: Authorizing `identity:get_user(user_id=6b7a13b716ae41fe869bdc7c6a99d2ff)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:16.972825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:16.974480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 575/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:16 2022] GET /identity/v3/users/6b7a13b716ae41fe869bdc7c6a99d2ff => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:16.980411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:17.076823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c003-866d-4ade-b2d3-b93a6f10b2fd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:17.109225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:17.109811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:17.110089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:17.110360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:17.167751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:17.175692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:17.177174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:17.270604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:05:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:05:17.276483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:17.373093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986df12-2114-4e9f-81b6-e0d9a01905d7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:17.405893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4798c81-5a4d-43fb-b5f6-83468ab64f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:17.406510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4798c81-5a4d-43fb-b5f6-83468ab64f95 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:17.406790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4798c81-5a4d-43fb-b5f6-83468ab64f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:17.407063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4798c81-5a4d-43fb-b5f6-83468ab64f95 None admin] PATH_INFO: `/v3/projects/945eeef0938847fca36dcae7b4adf084` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:17.408209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4798c81-5a4d-43fb-b5f6-83468ab64f95 None admin] RBAC: Authorizing `identity:get_project(project_id=945eeef0938847fca36dcae7b4adf084)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:17.409638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4798c81-5a4d-43fb-b5f6-83468ab64f95 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:17.411441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 576/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:17 2022] GET /identity/v3/projects/945eeef0938847fca36dcae7b4adf084 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:17.420048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:17.514382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:17.521184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d84263-2d45-42f6-a88a-bf8b616da838 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:17.553354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:17.553937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:17.554211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:17.554475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:17.555179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=945eeef0938847fca36dcae7b4adf084, user.id=6b7a13b716ae41fe869bdc7c6a99d2ff) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:17.555478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:17.556907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f337bd4-af06-4321-84cf-2d35ed645db5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:17.562975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 585/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:05:17 2022] GET /identity/v3/role_assignments?user.id=6b7a13b716ae41fe869bdc7c6a99d2ff&scope.project.id=945eeef0938847fca36dcae7b4adf084&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:05:19.486090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cc696-6155-4ed6-a27d-04e481cca41b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:19.486650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cc696-6155-4ed6-a27d-04e481cca41b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:19.486650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cc696-6155-4ed6-a27d-04e481cca41b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:19.488004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 577/1162] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:19.493323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:19.493749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:19.493854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:19.512155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:19.513323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:19.576808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:05:19.849716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cc696-6155-4ed6-a27d-04e481cca41b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:19.880675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:19.950068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cc696-6155-4ed6-a27d-04e481cca41b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:19.983345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:19.983962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:19.984246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:19.984516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:20.048138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:20.049567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:20.078501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:20.144361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:05:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:05:20.150169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:20.234317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:20.246157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad144b-20dc-42d7-a27e-1b5c1a07e6a3 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:20.279415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:20.280073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:20.280352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:20.280620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:20.286907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:20.288370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-a0b0c5b0-ad1d-48b9-842f-382adb6b7391 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:20.300149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:20.301469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:05:20.302629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 587/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:05:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:20.307113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:20.401327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e105e6a-47f0-4b2f-94c6-ae3230bd3536 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:20.429383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:20.434549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:20.435141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:20.435417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:20.435686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:20.436346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:20.436647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:20.438001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab21938-c1bd-438f-abf1-214e0eb76696 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:20.444999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 579/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Aug 31 12:05:20 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:22.318788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579a91-5d23-437b-a9c2-a8042655868a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:22.319297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579a91-5d23-437b-a9c2-a8042655868a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:22.319409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a579a91-5d23-437b-a9c2-a8042655868a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:22.320991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 588/1167] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:22.326004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909d5b-85ce-4dc2-aa85-3a1218b04a6d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:22.326398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909d5b-85ce-4dc2-aa85-3a1218b04a6d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:22.326555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28909d5b-85ce-4dc2-aa85-3a1218b04a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:22.345454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-28909d5b-85ce-4dc2-aa85-3a1218b04a6d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:22.346628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-28909d5b-85ce-4dc2-aa85-3a1218b04a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:22.410439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 580/1168] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:22.678093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a579a91-5d23-437b-a9c2-a8042655868a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:22.775367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a579a91-5d23-437b-a9c2-a8042655868a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:22.807407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863f3ae-a2b2-441c-9853-4c7491f17758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:22.808009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863f3ae-a2b2-441c-9853-4c7491f17758 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:22.808288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863f3ae-a2b2-441c-9853-4c7491f17758 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:22.808555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863f3ae-a2b2-441c-9853-4c7491f17758 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:22.809213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863f3ae-a2b2-441c-9853-4c7491f17758 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:22.810566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863f3ae-a2b2-441c-9853-4c7491f17758 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:22.826699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 589/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Wed Aug 31 12:05:22 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:05:24.737503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92433e3-7727-451c-b66a-d94b1abece98 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:24.738029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92433e3-7727-451c-b66a-d94b1abece98 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:24.738029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92433e3-7727-451c-b66a-d94b1abece98 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:24.739381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 581/1170] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:24.744474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:24.744880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:24.745024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:24.763069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:24.764268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:24.766170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:24.830008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 590/1171] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:05:25.093746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92433e3-7727-451c-b66a-d94b1abece98 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:25.190152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92433e3-7727-451c-b66a-d94b1abece98 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:25.214321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:25.224133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915ca88-1458-4fee-9f78-828346e99ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:25.224754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ca88-1458-4fee-9f78-828346e99ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:25.225030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ca88-1458-4fee-9f78-828346e99ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:25.225300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915ca88-1458-4fee-9f78-828346e99ad0 None admin] PATH_INFO: `/v3/domains/d342054e09e14770aa161774f0265beb` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:25.235829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ca88-1458-4fee-9f78-828346e99ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d342054e09e14770aa161774f0265beb)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:25.237306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7915ca88-1458-4fee-9f78-828346e99ad0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:25.238879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 582/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Aug 31 12:05:25 2022] GET /identity/v3/domains/d342054e09e14770aa161774f0265beb => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:25.244694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:25.337676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6cc4-38a5-48bd-b130-0ff329c23963 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:25.370602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01788180-6578-4e82-a211-5de72744e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:25.371144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01788180-6578-4e82-a211-5de72744e070 None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:25.371461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01788180-6578-4e82-a211-5de72744e070 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:25.371736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01788180-6578-4e82-a211-5de72744e070 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:25.372421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01788180-6578-4e82-a211-5de72744e070 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:25.373858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01788180-6578-4e82-a211-5de72744e070 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:25.382976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:25.399721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 591/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:05:25 2022] POST /identity/v3/projects => generated 361 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:05:27.348238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c53e79-bf0d-4c95-8306-47f803d83af7 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:27.348789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c53e79-bf0d-4c95-8306-47f803d83af7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:27.348789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c53e79-bf0d-4c95-8306-47f803d83af7 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:27.350128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 583/1174] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:27.355453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:27.356569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:27.356676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:27.373983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:27.375140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:27.437872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 592/1175] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:27.711372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c53e79-bf0d-4c95-8306-47f803d83af7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:27.814291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c53e79-bf0d-4c95-8306-47f803d83af7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:27.848146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6e23b-0bf7-4499-8434-71111d44bf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:27.848765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6e23b-0bf7-4499-8434-71111d44bf23 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:27.849046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6e23b-0bf7-4499-8434-71111d44bf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:27.849322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6e23b-0bf7-4499-8434-71111d44bf23 None admin] PATH_INFO: `/v3/domains/d342054e09e14770aa161774f0265beb` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:27.850440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6e23b-0bf7-4499-8434-71111d44bf23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=d342054e09e14770aa161774f0265beb)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:27.851865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6e23b-0bf7-4499-8434-71111d44bf23 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:27.853457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 584/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Aug 31 12:05:27 2022] GET /identity/v3/domains/d342054e09e14770aa161774f0265beb => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:27.859135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:27.963893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cc3c8-00d7-44f8-a49e-ebfce08af379 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:27.983954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:27.998408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3bcb3-ff07-4def-a9eb-8be18d71ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:27.999007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bcb3-ff07-4def-a9eb-8be18d71ef4d None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:27.999282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bcb3-ff07-4def-a9eb-8be18d71ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:27.999577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3bcb3-ff07-4def-a9eb-8be18d71ef4d None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:28.000248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bcb3-ff07-4def-a9eb-8be18d71ef4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:28.001676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3bcb3-ff07-4def-a9eb-8be18d71ef4d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:28.022930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 593/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:05:27 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:05:29.951209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef149b-040f-47b0-b984-16ccbe5996a1 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:29.951768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef149b-040f-47b0-b984-16ccbe5996a1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:29.951768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef149b-040f-47b0-b984-16ccbe5996a1 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:29.953113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 585/1178] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:29.958806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:29.959198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:29.959362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:29.978684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:29.979876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:30.043816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 594/1179] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:30.325967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef149b-040f-47b0-b984-16ccbe5996a1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:30.380401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:30.423751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef149b-040f-47b0-b984-16ccbe5996a1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:30.457225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:30.457834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:30.458108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:30.458374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:30.469045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:05:30.473894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:30.475170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:05:30.476377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 586/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:05:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:30.482446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:30.578633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061ebef-3ee7-422f-b28f-6d43f8471d7b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:30.585541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:30.612544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:30.613170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:30.613445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:30.613720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:30.614373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:30.614674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:30.616079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:30.623805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 595/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:05:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:30.629497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:30.724700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b2c7d-9cda-4f51-9dc6-243862f3db8c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:30.737466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:30.756760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:30.757367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:30.757643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:30.757913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] PATH_INFO: `/v3/users/45751d95bcce4d4d8fcd89f10350f6c9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:30.770962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=45751d95bcce4d4d8fcd89f10350f6c9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:30.772416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:30.773977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 587/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:30 2022] GET /identity/v3/users/45751d95bcce4d4d8fcd89f10350f6c9 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:05:30.780411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:30.876405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20a903-5e6a-47cb-9f5d-c83ce8f58975 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:30.909055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:30.909640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:30.909914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:30.910180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:30.943274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:30.975095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:30.976578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:31.069595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 596/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:05:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:05:31.076279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:31.171396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02d26e-fd9e-43c8-96f1-04cbd9fe4fe7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:31.204411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e869d-763d-446a-b892-e1d8d28b502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:31.205016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e869d-763d-446a-b892-e1d8d28b502d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:31.205293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e869d-763d-446a-b892-e1d8d28b502d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:31.205562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e869d-763d-446a-b892-e1d8d28b502d None admin] PATH_INFO: `/v3/projects/6644d3851a9a48ebafa753f988991d83` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:31.206664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e869d-763d-446a-b892-e1d8d28b502d None admin] RBAC: Authorizing `identity:get_project(project_id=6644d3851a9a48ebafa753f988991d83)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:31.208112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772e869d-763d-446a-b892-e1d8d28b502d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:31.209702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 588/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:31 2022] GET /identity/v3/projects/6644d3851a9a48ebafa753f988991d83 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:31.216136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:31.280094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:31.312949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e0c5f8-8851-4fe5-972b-1bec2304ada1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:31.344911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:31.345494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:31.345767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:31.346033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:31.346743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=6644d3851a9a48ebafa753f988991d83, user.id=45751d95bcce4d4d8fcd89f10350f6c9) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:31.347046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:31.348516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea373fb4-7023-4482-8510-51d8b5e9f087 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:31.353654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 597/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:05:31 2022] GET /identity/v3/role_assignments?user.id=45751d95bcce4d4d8fcd89f10350f6c9&scope.project.id=6644d3851a9a48ebafa753f988991d83&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:33.227923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc247-3f4f-47b5-b506-dbd74cb87a55 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:33.228460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc247-3f4f-47b5-b506-dbd74cb87a55 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:33.228460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fc247-3f4f-47b5-b506-dbd74cb87a55 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:33.229754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 589/1186] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:33.235325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:33.235742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:33.235973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:33.253641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:33.254807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:33.320965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 598/1187] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:33.585011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc247-3f4f-47b5-b506-dbd74cb87a55 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:33.628025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:33.686909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fc247-3f4f-47b5-b506-dbd74cb87a55 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:33.720527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:33.721145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:33.721424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:33.721695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:33.731886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:05:33.736702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:33.737797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:05:33.738679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 590/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:33.743770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:33.804820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:33.843049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f89a4b-cd9a-491f-88eb-fc8f0a38f78e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:33.876433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:33.877025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:33.877304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:33.877573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:33.878226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:33.878548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:33.879979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:33.887646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 599/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:33.893273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:33.991537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:33.994418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e204c3-f447-456c-8e02-dfd6ff245bbe None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:34.032703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:34.033771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:34.034268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:34.034752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] PATH_INFO: `/v3/users/45751d95bcce4d4d8fcd89f10350f6c9` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:34.036795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] RBAC: Authorizing `identity:get_user(user_id=45751d95bcce4d4d8fcd89f10350f6c9)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:34.039065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:34.041639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 591/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:33 2022] GET /identity/v3/users/45751d95bcce4d4d8fcd89f10350f6c9 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:34.047658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:34.145095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c94b9-6725-4ce5-9cbf-a4a4060c5247 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:34.166711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:34.177325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f466d372-2f89-4651-ae6f-091bbdceb4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:34.177939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d372-2f89-4651-ae6f-091bbdceb4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:34.178220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d372-2f89-4651-ae6f-091bbdceb4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:34.178494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f466d372-2f89-4651-ae6f-091bbdceb4b0 None admin] PATH_INFO: `/v3/projects/6644d3851a9a48ebafa753f988991d83` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:34.179596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466d372-2f89-4651-ae6f-091bbdceb4b0 None admin] RBAC: Authorizing `identity:get_project(project_id=6644d3851a9a48ebafa753f988991d83)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:34.181058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f466d372-2f89-4651-ae6f-091bbdceb4b0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:34.182660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 600/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:34 2022] GET /identity/v3/projects/6644d3851a9a48ebafa753f988991d83 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:34.189030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:34.285226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804feed8-0a0b-45cf-887b-09791df2cbbc None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:34.317768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea90277-1ec6-4ffc-887c-05f90b613eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:34.318403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90277-1ec6-4ffc-887c-05f90b613eb7 None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:34.318680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90277-1ec6-4ffc-887c-05f90b613eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:34.318951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea90277-1ec6-4ffc-887c-05f90b613eb7 None admin] PATH_INFO: `/v3/projects/6644d3851a9a48ebafa753f988991d83/users/45751d95bcce4d4d8fcd89f10350f6c9/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:34.321120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea90277-1ec6-4ffc-887c-05f90b613eb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=6644d3851a9a48ebafa753f988991d83, user_id=45751d95bcce4d4d8fcd89f10350f6c9, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:34.322532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea90277-1ec6-4ffc-887c-05f90b613eb7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:34.335557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 592/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:05:34 2022] PUT /identity/v3/projects/6644d3851a9a48ebafa753f988991d83/users/45751d95bcce4d4d8fcd89f10350f6c9/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:05:36.206761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905385-c2c1-4b1b-a617-00629f13d5c6 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:36.207284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905385-c2c1-4b1b-a617-00629f13d5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:36.207284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905385-c2c1-4b1b-a617-00629f13d5c6 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:36.208583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 601/1193] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:05:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:05:36.213804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:36.214177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:36.214355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:36.232530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:05:36.233705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:05:36.255404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:36.299119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 593/1194] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:05:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:05:36.565861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905385-c2c1-4b1b-a617-00629f13d5c6 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:36.663770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905385-c2c1-4b1b-a617-00629f13d5c6 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:36.696924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:36.697531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:36.697809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:36.698078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:36.708316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:05:36.713049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:05:36.714137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:05:36.715271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 602/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:05:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:05:36.720129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:36.814380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0484483-3230-4f32-9aa2-133da3198884 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:36.847106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:36.847642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:36.847920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:36.848218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:36.848869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:36.849167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:36.850519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:36.858738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 594/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:05:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:36.864363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:36.915229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:36.962978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b923bd-bbcd-4441-8602-b2f02e458c7b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:36.995702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:36.996944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:36.997225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:36.997497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] PATH_INFO: `/v3/users/45751d95bcce4d4d8fcd89f10350f6c9` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:36.998604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] RBAC: Authorizing `identity:get_user(user_id=45751d95bcce4d4d8fcd89f10350f6c9)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:37.000057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:37.001612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 603/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Aug 31 12:05:36 2022] GET /identity/v3/users/45751d95bcce4d4d8fcd89f10350f6c9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:37.007467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:37.028782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:37.104317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c5d35-cfa8-40e8-86b2-d2d2fc350658 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:37.137997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:37.138593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:37.138872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:37.139144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:37.204902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:37.206346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:37.225562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:37.300367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 595/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:05:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:05:37.306274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:37.403042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d97d90-6677-4adb-9708-cbf5089c1947 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:37.421432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:37.435478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17246df-3bd6-4c0a-8c2e-264c237e6dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:37.436114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17246df-3bd6-4c0a-8c2e-264c237e6dfd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:37.436391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17246df-3bd6-4c0a-8c2e-264c237e6dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:37.436663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17246df-3bd6-4c0a-8c2e-264c237e6dfd None admin] PATH_INFO: `/v3/projects/6644d3851a9a48ebafa753f988991d83` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:37.437751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17246df-3bd6-4c0a-8c2e-264c237e6dfd None admin] RBAC: Authorizing `identity:get_project(project_id=6644d3851a9a48ebafa753f988991d83)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:37.439163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17246df-3bd6-4c0a-8c2e-264c237e6dfd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:37.440763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 604/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Aug 31 12:05:37 2022] GET /identity/v3/projects/6644d3851a9a48ebafa753f988991d83 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:37.447083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:05:37.541831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735625bd-1cee-4316-af8a-c3ada5c2b394 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:05:37.561866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:37.575981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:05:37.576580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:05:37.576860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:05:37.577134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:05:37.577849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=6644d3851a9a48ebafa753f988991d83, user.id=45751d95bcce4d4d8fcd89f10350f6c9) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:05:37.578158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:05:37.579577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b076d3ac-6518-4fb5-a067-9d748ff9a4b5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:05:37.585277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 596/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:05:37 2022] GET /identity/v3/role_assignments?user.id=45751d95bcce4d4d8fcd89f10350f6c9&scope.project.id=6644d3851a9a48ebafa753f988991d83&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:05:47.431001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:05:47.582626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=8 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:32.478975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208875c-2413-4995-98ba-83ac8067a223 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:32.479607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208875c-2413-4995-98ba-83ac8067a223 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:32.479607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208875c-2413-4995-98ba-83ac8067a223 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:32.481154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 605/1201] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:06:32.486697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:32.487382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:32.487382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:32.507204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:32.508450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:32.601563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 597/1202] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:06:32.876879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208875c-2413-4995-98ba-83ac8067a223 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:33.028423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208875c-2413-4995-98ba-83ac8067a223 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:33.074724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:33.075363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:33.075645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:33.075915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:33.087589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:33.089673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:33.106730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:33.108416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:33.109491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:33.109491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:33.109491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:33.109491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 606/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:06:33.113773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:33.247009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3c0e07-64b6-4f01-8908-274c8415d998 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:33.295532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:33.302893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:33.303517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:33.303794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:33.304128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:33.304783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:33.305082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:33.306910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a9bf-0ea4-440b-90df-b8aa33c4741b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:33.320677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 598/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:33.327205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:33.390400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:33.459455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e5450-0f36-4373-976e-054d2e78a489 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:33.509456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaf740-c26c-42f0-9075-36e384a91daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:33.510785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaf740-c26c-42f0-9075-36e384a91daf None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:33.510976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaf740-c26c-42f0-9075-36e384a91daf None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:33.511215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaf740-c26c-42f0-9075-36e384a91daf None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:33.512037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daaf740-c26c-42f0-9075-36e384a91daf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:33.513668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daaf740-c26c-42f0-9075-36e384a91daf None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:33.543680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 607/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Aug 31 12:06:33 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:06:35.701016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47c2e-9578-428f-93f5-0390b6130521 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:35.701593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47c2e-9578-428f-93f5-0390b6130521 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:35.701593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47c2e-9578-428f-93f5-0390b6130521 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:35.702928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 599/1206] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:06:35.712390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:35.712390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:35.712390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:35.731824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:35.733204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:35.816755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 608/1207] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:06:36.116338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47c2e-9578-428f-93f5-0390b6130521 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:36.263687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47c2e-9578-428f-93f5-0390b6130521 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:36.306443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:36.307769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:36.308090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:36.308367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:36.322039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:06:36.328028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:36.329257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:36.330381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 600/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:36.338259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:36.387135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:36.460873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692a3e0-5a92-443b-a272-f0d05726439a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:36.505907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:36.506623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:36.507018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:36.507383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:36.508095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:36.508422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:36.510810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:36.525004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 609/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:06:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:06:36.527377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:36.587364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:36.651462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63503005-8570-4a61-92a6-36de41aa2d37 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:36.692723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:36.693429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:36.693731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:36.694052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:36.709491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:36.711302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:36.729676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:36.730956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:36.732126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:36.732126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:36.732126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:36.736100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 601/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:36.737175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:36.861942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:36.866760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851c6870-6d0c-4875-9fe7-fbd66884892b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:36.908959 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:36.910588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:36.910588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:36.910588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:36.910871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:36.911082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:36.912566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:36.930362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 610/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:36.933753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:37.048716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c68bc-b8ac-4305-8c03-26a94b468613 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:37.050316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:37.088879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:37.089683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:37.090048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:37.090407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:37.098542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:37.100466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:06:37.113249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:37.114467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:37.115435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 602/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:37.120859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:37.237613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4bef27-ec71-4d96-bc99-eea145e712ac None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:37.279611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:37.280402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:37.280689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:37.280976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:37.281942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:37.282348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:37.283782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:37.304415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 611/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 31 12:06:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:06:37.311931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:37.436851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b34eba-cf34-4fb4-98f5-3e30f4f0c68e None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:37.475138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:37.475871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:37.476902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:37.476902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:37.512580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:37.559289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:37.561055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:37.685046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 603/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:06:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:06:37.692446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:37.719253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:37.814367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe91fca-3dd5-4424-8305-eb29018a83a5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:37.855964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:37.856965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:37.857363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:37.857795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:37.873543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:37.875047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:37.895535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:37.896870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:37.897903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:37.897903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:37.897903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:37.898076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 612/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:37.904948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:37.975442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:38.023596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612e631b-a1c9-4e10-823c-cf7c0da37f80 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:38.061142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:38.062075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:38.062354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:38.062617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:38.063299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:38.063649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:38.065128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:38.078344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 604/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:38.084175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:38.163676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:38.202947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59001d9-6c10-44c9-951f-3186091ee963 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:38.240968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:38.241493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:38.241858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:38.242151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:38.249951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:38.251462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:06:38.264481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:38.270310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:38.271515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 613/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:38.272690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:38.388176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2250b-3b27-4224-b314-6d203ce116a2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:38.414253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:38.426737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:38.427453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:38.427799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:38.428163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:38.428925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:38.429298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:38.430797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ddc0c-21e9-451a-9f65-7ef295fc0224 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:38.449904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 605/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:38.452059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:38.575552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee24d307-e2f0-41ce-b766-64db9fc09138 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:38.610489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:38.617176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:38.618032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:38.618333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:38.618824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:38.620377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=952511916961431fb58ba2e07e24f4f2) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:38.620698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:38.622670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a4c6-24d8-47dd-b5b3-9859430997a8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:38.630570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 614/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:06:38 2022] GET /identity/v3/role_assignments?user.id=952511916961431fb58ba2e07e24f4f2&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:40.689598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb541c13-bbac-4dc4-9c6b-481ec000ad7a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:40.690179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb541c13-bbac-4dc4-9c6b-481ec000ad7a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:40.690179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb541c13-bbac-4dc4-9c6b-481ec000ad7a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:40.691486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 606/1220] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:06:40.697186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:40.697628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:40.697922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:40.719520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:40.721479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:40.792615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 615/1221] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:06:41.060918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb541c13-bbac-4dc4-9c6b-481ec000ad7a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:41.170681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb541c13-bbac-4dc4-9c6b-481ec000ad7a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:41.210493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:41.211230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:41.211558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:41.211858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:41.223755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:06:41.228984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:41.230168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:41.231042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 607/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:41.236162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:41.336208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5999dcdc-8d96-4c21-b732-789de4a5551e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:41.360240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:41.371791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:41.372648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:41.372977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:41.373355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:41.374137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:41.374441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:41.376405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:41.389266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 616/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:06:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:41.395139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:41.448368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:41.507559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3ca954-9803-4383-b87f-7b8bcdf0fb48 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:41.546903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:41.547748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:41.548213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:41.548493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:41.561269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:41.563223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:41.582495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:41.583655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:41.589554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:41.589554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:41.589554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:41.589554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 608/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:41.590070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:41.703494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3fae90-fc8f-4fd2-9f59-2e9dbd2703a8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:41.738519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:41.739124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:41.739403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:41.739729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:41.740362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:41.740668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:41.742028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:41.754404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 617/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:41.760399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:41.868341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:41.876716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdeafe2-3c00-43f5-83d6-dcd36ef2dff5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:41.912066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:41.912734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:41.913089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:41.913386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] PATH_INFO: `/v3/users/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:41.921927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:41.923359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:06:41.935207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:41.936443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:41.937748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 609/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:41.942329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:41.994975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:42.050539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff7865-a5e1-4e30-a9ba-ca48f1aa0c54 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:42.086513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:42.087133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:42.087404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:42.088243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:42.089033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:42.089345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:42.090781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:42.109197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 618/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 31 12:06:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:06:42.114943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:42.231059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1479b9-e5b8-4cff-90c7-6851e238cdff None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:42.268361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:42.269069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:42.269461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:42.269735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:42.281475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:42.282923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:42.299154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:42.300386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:42.301703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:42.301703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:42.301703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:42.301703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 610/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:42.306847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:42.412865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26a2e-8f38-4dce-9492-7593ca081d70 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:42.415578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:42.452263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:42.453031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:42.453350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:42.453668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:42.454482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:42.454807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:42.456411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:42.470161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 619/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:42.476341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:42.487427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:42.597583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8150d7c-d4c5-46f0-9307-5de9e4d81e43 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:42.641675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:42.642356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:42.642624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:42.642899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:42.651314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:42.652868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:06:42.664500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:42.665663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:42.666718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 611/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:42.671799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:42.787637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05875583-f3ce-440d-a622-e6f6f53ab5ec None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:42.828357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:42.828962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:42.829257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:42.829516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:42.830207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:42.830544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:42.832014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad2897-4e4a-4a5f-91a3-ce100a2d0601 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:42.844358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 620/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:06:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:42.850452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:42.918736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:42.955709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e881e3f-4be7-49a3-b2a6-6053fbc4f53a None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:42.990486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88d574-bdc4-4831-950e-2c11e8d259fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:42.991319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88d574-bdc4-4831-950e-2c11e8d259fc None admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:42.991452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88d574-bdc4-4831-950e-2c11e8d259fc None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:42.991781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88d574-bdc4-4831-950e-2c11e8d259fc None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/952511916961431fb58ba2e07e24f4f2/roles/a9a3ba8e4d5c484abcf62ae5a03c5848` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:43.008059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88d574-bdc4-4831-950e-2c11e8d259fc None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=952511916961431fb58ba2e07e24f4f2, role_id=a9a3ba8e4d5c484abcf62ae5a03c5848)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:43.010213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88d574-bdc4-4831-950e-2c11e8d259fc None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:43.022666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 612/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:06:42 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/952511916961431fb58ba2e07e24f4f2/roles/a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:06:45.141048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbcf7-3f43-432b-a0db-69af93946946 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:45.141690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbcf7-3f43-432b-a0db-69af93946946 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:45.141823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090bbcf7-3f43-432b-a0db-69af93946946 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:45.143876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 621/1233] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:06:45.152212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:45.152685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:45.152768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:45.175358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:45.176882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:45.256544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 613/1234] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:06:45.557584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbcf7-3f43-432b-a0db-69af93946946 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:45.586272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:45.672267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090bbcf7-3f43-432b-a0db-69af93946946 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:45.711010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:45.711744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:45.712065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:45.712342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:45.724149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:06:45.729376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:45.730446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:45.731533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 622/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Aug 31 12:06:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:45.737155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:45.786795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:45.846225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7e456-45cc-4430-bcb0-497e253eee49 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:45.883336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:45.883969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:45.884265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:45.884577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:45.885254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:45.885560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:45.887475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:45.896402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 614/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Aug 31 12:06:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:45.902627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:46.001415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:46.020096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e5913-332b-44fc-b437-810727972318 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:46.058945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:46.059640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:46.059932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:46.060256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:46.072840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:46.074393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:46.090112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:46.091290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:46.092497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:46.092497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:46.092497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:46.093984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 623/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:06:46.100046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:46.213697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbda33b-f40d-47be-a37a-dc940fd59cf2 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:46.222854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:46.250196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:46.250797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:46.251073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:46.251355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:46.252012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:46.252319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:46.253677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:46.265929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 615/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:46.272556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:46.382824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79af17f-0341-47c2-b46a-05b0094da2ba None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:46.422426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:46.423037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:46.423311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:46.423577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:46.426542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:46.432441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:46.434198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:06:46.447600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:46.448777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:46.449793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 624/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:46.455977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:46.572284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d72baf-7e7e-4132-b0a4-89a0c9efc85b None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:46.612646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:46.613265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:46.613543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:46.613845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:46.614583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:46.614890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:46.616553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:46.635989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 616/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 31 12:06:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:46.641818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:46.749206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001b3ef-89d0-4451-8229-cd58e142d4a1 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:46.784216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:46.784828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:46.785181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:46.785587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:46.852117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:46.860570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:46.862157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:46.968397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 625/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:06:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 31 12:06:46.975053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:47.005262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:47.086564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e2dfe-b123-46a0-b540-d28b52542ef4 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:47.126105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:47.126784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:47.127072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:47.127441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:47.139032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:47.140585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:47.159762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:47.161151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:47.162521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:47.162521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:47.162521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:47.162521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 617/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:06:47.169132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:47.278821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:47.286469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63352e0-a954-4816-8854-3bd48fb9384b None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:47.325657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:47.326236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:47.326514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:47.326804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:47.327433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:47.327730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:47.329141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:47.340802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 626/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:47.347324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:47.437274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:47.462710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531cc9b4-e289-4e66-8bba-ec284291474c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:47.499082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:47.499719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:47.500053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:47.500353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:47.507534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:47.509132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:06:47.522343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:47.523578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:47.524706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 618/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:47.529697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:47.639224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5b1aa-c6de-4abb-a999-a2b6653fd9d4 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:47.686136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:47.686795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:47.687112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:47.687393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:47.688188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:47.688500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:47.690195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61249899-3ea0-4000-936c-4689b0fa253d None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:47.704029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 627/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:47.711031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:47.815079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed0ad0-5846-4251-8e5d-d7693b1bb95f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:47.852213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:47.853643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:47.853932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:47.854283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:47.855037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] RBAC: Adding query filter params (role.id=a9a3ba8e4d5c484abcf62ae5a03c5848, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=952511916961431fb58ba2e07e24f4f2) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:47.855440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:47.857056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18af3372-3919-405b-93f8-0aa49bc85fb0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:47.863894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 619/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:06:47 2022] GET /identity/v3/role_assignments?user.id=952511916961431fb58ba2e07e24f4f2&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a9a3ba8e4d5c484abcf62ae5a03c5848 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:06:50.122102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2f29a-aaa0-4933-b99c-a2618e20d120 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:50.122102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2f29a-aaa0-4933-b99c-a2618e20d120 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:50.122102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a2f29a-aaa0-4933-b99c-a2618e20d120 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:50.122102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 628/1247] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:06:50.129322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:50.129791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:50.129956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:50.137177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:50.159385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:50.161748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:50.245764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 620/1248] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:06:50.587547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2f29a-aaa0-4933-b99c-a2618e20d120 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:50.609607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:50.706529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a2f29a-aaa0-4933-b99c-a2618e20d120 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:50.744830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:50.745507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:50.745788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:50.746060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:50.757182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:06:50.762896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:50.764069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:50.765175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 629/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:50.770502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:50.871621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ef165-a185-48d5-a8e2-6b884662e466 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:50.910225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:50.919743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:50.920427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:50.920710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:50.920984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:50.921663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:50.921968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:50.923344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:50.937569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 621/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:50.939028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:51.030857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:51.056854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035c1a1-4f74-4b09-a967-05c5ce4be77c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:51.094063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:51.094823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:51.095052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:51.095363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:51.108333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:51.109792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:51.125128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:51.126927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:51.128099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:51.128099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:51.128099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:51.128099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 630/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:51.132295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:51.252376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab40bca-c2b4-4067-b8db-0c0953398086 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:51.287354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:51.287995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:51.288287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:51.288555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:51.289194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:51.289492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:51.290855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:51.304228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 622/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:06:51.310841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:51.416379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aea724-15e6-48aa-9d10-49a7e61fc351 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:51.444890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:51.454763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:51.455589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:51.455869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:51.456173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:51.464233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:51.465698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:06:51.477598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:51.479103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:51.480167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 631/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 31 12:06:51.485383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:51.539763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:51.593218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef867c6f-15ec-4762-8a85-11a745c9585f None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:51.630562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:51.631168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:51.631487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:51.631718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:51.632483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:51.632785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:51.634245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:51.652249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 623/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 31 12:06:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:51.658114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:51.765050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd134997-fb5c-46b3-85df-98ab0f69e4f5 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:51.802801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:51.803584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:51.803930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:51.804247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:51.862718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:51.877339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:51.878800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:52.003447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 632/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:06:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:06:52.004867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:52.116008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78628a7c-10c8-48bf-aa9b-eaba61ae7483 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:52.132849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:52.159661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:52.160323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:52.160603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:52.160877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:52.172622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:52.174513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:52.194475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:52.195728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:52.197240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:52.197240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:52.197240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:52.197240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 624/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:52.202402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:52.298960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:52.312953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf26ab5-43ee-4a23-a2a1-b6e9425cb91e None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:52.350099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:52.350719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:52.351003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:52.351279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:52.351935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:52.352265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:52.354211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:52.366829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 633/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:06:52.373324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:52.479231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c92201-2329-4059-940c-6b8803d6abc3 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:52.514073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:52.514709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:52.514985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:52.515255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:52.522414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:52.523884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:06:52.536480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:52.537491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:52.538948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 625/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:52.544368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:52.648407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237f7d1d-41d9-4a20-8f95-443e80d556d0 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:52.685305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:52.685909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:52.686183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:52.686450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:52.687135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:52.687435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:52.688885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fb22d-4b72-4424-91d0-4deddf180572 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:52.701113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 634/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:52.707352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:52.734670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:52.810547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e7633-effa-4984-8962-1e5d7c9acf4c None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:52.845257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:52.846130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:52.846405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:52.846673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:52.847390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=952511916961431fb58ba2e07e24f4f2) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:52.847694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:52.849150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c533f2-007a-4e3a-8d6d-5225ac12a4a8 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:52.855175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 626/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:06:52 2022] GET /identity/v3/role_assignments?user.id=952511916961431fb58ba2e07e24f4f2&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:54.733992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7661b-9857-46a6-aa46-e1d26ed355d9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:54.734564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7661b-9857-46a6-aa46-e1d26ed355d9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:54.734564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de7661b-9857-46a6-aa46-e1d26ed355d9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:54.735956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 635/1261] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:06:54.741101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:54.741522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:54.741641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:54.759965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:54.761137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:54.824917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 627/1262] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:06:55.101619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7661b-9857-46a6-aa46-e1d26ed355d9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:55.112417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:55.212055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de7661b-9857-46a6-aa46-e1d26ed355d9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:55.246658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:55.247323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:55.247563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:55.247834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:55.257569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:06:55.262471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:55.263587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:55.264689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 636/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:55.269586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:55.287155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:55.365298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f32447-df1b-465b-b321-43b4d4415e14 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:55.397626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:55.398217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:55.398495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:55.398764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:55.399415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:55.399740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:55.401130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:55.408837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 628/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:55.414445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:55.480767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:55.513543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52498ff4-758e-4114-b733-58b8ea3646a3 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:55.547688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:55.548425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:55.548742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:55.549038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:55.558801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:55.560264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:55.574676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:55.575776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:55.577022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:55.577022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:55.577022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:55.577022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 637/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:55.581532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:55.659792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:55.679786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700e420-dcc8-4d75-bf85-a14d26134d12 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:55.712633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:55.713233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:55.713514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:55.713785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:55.714418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:55.714718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:55.716115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:55.727516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 629/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:55.733615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:55.829650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b21ee-362e-4555-99cf-8c9796cf091f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:55.848822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:55.863122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:55.863736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:55.864050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:55.864329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:55.871652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:55.873113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:06:55.884546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:55.890157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:55.891225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 638/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:55.891835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:55.988679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2f109-e0c1-4cb3-a522-3e5ded9f47a5 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:56.021289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:56.021885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:56.022164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:56.022434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:56.023152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:56.023457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:56.025511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:56.033781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:56.042298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 630/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 31 12:06:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:56.047906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:56.144456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1388b9c6-46d7-4c8b-8821-b70905bd383f None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:56.184953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:56.185577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:56.185853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:56.186119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:56.197084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:56.198510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:56.212606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:56.213711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:56.214800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:56.214800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:56.214800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:56.214800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 639/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:56.219485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:56.315477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b34b3-cd02-4ab0-8ca7-bbdb53c64ce7 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:56.349115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:56.349704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:56.349986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:56.350258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:56.350901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:56.351202 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:56.353177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:56.364936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 631/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:56.370481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:56.401738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:56.468341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8af76-c3f6-4ed7-b550-d1c8f8ccf4d8 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:56.500506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:56.501116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:56.501396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:56.501673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:56.508041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:56.509517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:06:56.520440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:56.521494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:06:56.522601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 640/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:56.527802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:56.583759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:56.624663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da180ea-0f9a-490b-8df3-dba18bba3c59 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:56.657525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:56.658113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:56.658389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:56.658658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:56.659340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:56.659642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:56.661079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb38793-e2c6-4f18-b4a6-401c5df909f9 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:56.672401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 632/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:56.678593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:56.767371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:56.777201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7caf528-aa29-4951-b05c-718708af32dd None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:56.809412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a5915-211b-4c4f-9ad2-920666c034fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:56.810050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5915-211b-4c4f-9ad2-920666c034fd None admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:56.810329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5915-211b-4c4f-9ad2-920666c034fd None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:56.810598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a5915-211b-4c4f-9ad2-920666c034fd None admin] PATH_INFO: `/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/952511916961431fb58ba2e07e24f4f2/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:56.812603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5915-211b-4c4f-9ad2-920666c034fd None admin] RBAC: Authorizing `identity:create_grant(project_id=9c34c6eaa4b74ce39e7ad65daae8f607, user_id=952511916961431fb58ba2e07e24f4f2, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:56.814024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a5915-211b-4c4f-9ad2-920666c034fd None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:56.826326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 641/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Aug 31 12:06:56 2022] PUT /identity/v3/projects/9c34c6eaa4b74ce39e7ad65daae8f607/users/952511916961431fb58ba2e07e24f4f2/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:06:58.707911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef76f2f-60b2-43e7-a26a-9a51e369756c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:58.708488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef76f2f-60b2-43e7-a26a-9a51e369756c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:58.708488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef76f2f-60b2-43e7-a26a-9a51e369756c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:58.709812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 633/1274] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:06:58.714945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf550507-273f-460b-99c4-6362000acfab None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:58.715323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf550507-273f-460b-99c4-6362000acfab None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:58.715503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf550507-273f-460b-99c4-6362000acfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:58.733303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cf550507-273f-460b-99c4-6362000acfab None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:06:58.734559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cf550507-273f-460b-99c4-6362000acfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:06:58.798939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 642/1275] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:06:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:06:59.068853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef76f2f-60b2-43e7-a26a-9a51e369756c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:59.169950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef76f2f-60b2-43e7-a26a-9a51e369756c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:59.190795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:59.209783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:59.210417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:59.210697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:59.210965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:59.222532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 31 12:06:59.227412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:59.228582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:59.229439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 634/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Aug 31 12:06:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:59.234677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf550507-273f-460b-99c4-6362000acfab None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:59.313354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:59.332716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf550507-273f-460b-99c4-6362000acfab None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:59.364553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:59.365151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:59.365430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:59.365698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:59.366352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:59.366653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:59.368557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:59.376210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 643/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Aug 31 12:06:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:59.381905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:59.478805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e256b9-d7c6-41e7-8428-374dbb989816 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:59.512410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:59.513027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:59.513305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:59.513576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:59.523249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:59.524737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:06:59.538816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:59.539795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:06:59.540778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:06:59.540778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:06:59.540778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:59.540778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 635/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:59.545637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:59.644281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02649761-e219-4120-9410-fcd4e969ec05 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:59.675793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:59.676405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:59.676681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:59.676949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:59.677574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:59.677869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:59.679224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:59.690309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 644/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:06:59.696736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:59.726949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:59.792738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c767da-97f7-4d89-a32e-a8635c7406de None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:59.824998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:59.825638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:59.825916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:59.826213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:59.834053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:59.835485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 31 12:06:59.846265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:06:59.847382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:06:59.848582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 636/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:06:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:06:59.853547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:06:59.857311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:06:59.949485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a16ef37-6b17-44f8-a9f9-09c9dc2f111c None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:06:59.984867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:06:59.985498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:06:59.985793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:06:59.986047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:06:59.986768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:06:59.987074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:06:59.988535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:00.005551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 645/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Aug 31 12:06:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:00.011408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:00.098241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:00.108499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03221519-bfd3-4760-9e00-1f3f00e993ba None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:00.140035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:00.140649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:00.140922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:00.141189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:00.205311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:00.206683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:00.290379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:00.301157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 637/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Aug 31 12:07:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 31 12:07:00.306927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:00.366041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:00.404325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c78f0-0419-49f5-b1fe-575e7b970411 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:00.437412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:00.438026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:00.438306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:00.438580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:00.449039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:00.450484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 31 12:07:00.465309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:07:00.466492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 31 12:07:00.467654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 31 12:07:00.467654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 31 12:07:00.467654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:07:00.467654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 646/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:07:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:07:00.471976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:00.566291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f1304-7076-4014-a487-5b6444e8576d None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:00.599762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:00.600451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:00.600733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:00.601002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:00.601632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:00.601933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:00.603289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:00.614199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 638/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Aug 31 12:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:00.619723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:00.715747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1e4cca-7fbc-4e82-b37a-e1261dade549 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:00.728518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:00.748037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:00.748639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:00.748916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:00.749183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:00.755482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:00.756931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 31 12:07:00.768322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application with Lock( Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:07:00.769407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: ERROR keystone.server.flask.application Aug 31 12:07:00.770711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 647/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Aug 31 12:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:07:00.775145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:00.824370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:00.872213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bca55b-468e-4cd8-9e9a-e4af7fc25713 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:00.904504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:00.905098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:00.905376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:00.905645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:00.906354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:00.906658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:00.908099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f50da64-64f0-4d22-a6a6-650af94bc991 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:00.919587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 639/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Aug 31 12:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:00.925577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:01.022025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591311-5ee9-4955-a835-4261d2d2b387 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:01.054959 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21960f-58df-4820-823e-aba636572364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:01.055583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21960f-58df-4820-823e-aba636572364 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:01.055864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21960f-58df-4820-823e-aba636572364 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:01.056160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21960f-58df-4820-823e-aba636572364 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:01.056874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21960f-58df-4820-823e-aba636572364 None admin] RBAC: Adding query filter params (role.id=a873026ad8774923ae8b3c5920a3c3aa, scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607, user.id=952511916961431fb58ba2e07e24f4f2) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:01.057179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21960f-58df-4820-823e-aba636572364 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:01.058596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21960f-58df-4820-823e-aba636572364 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:01.064201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 648/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Aug 31 12:07:00 2022] GET /identity/v3/role_assignments?user.id=952511916961431fb58ba2e07e24f4f2&scope.project.id=9c34c6eaa4b74ce39e7ad65daae8f607&role.id=a873026ad8774923ae8b3c5920a3c3aa => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:02.953634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099b8da-d872-431b-b719-805f27c3a460 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:02.954181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099b8da-d872-431b-b719-805f27c3a460 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:02.954181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2099b8da-d872-431b-b719-805f27c3a460 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:02.955503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 640/1288] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:07:02.960751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:02.961143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:02.961300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:02.979552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:07:02.980751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:07:03.009705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:03.045007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 649/1289] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:07:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:07:03.334141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099b8da-d872-431b-b719-805f27c3a460 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:03.431452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2099b8da-d872-431b-b719-805f27c3a460 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:03.442265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:03.464945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:03.465558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:03.465833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:03.466099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:03.466667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:03.468034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:07:03.476449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:07:03.478170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:03.479295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 641/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:07:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:07:03.483988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:03.580226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e5af6-5c91-42df-902c-95701b728c17 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:03.614437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:03.614966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:03.615241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:03.615511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:03.616153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:03.616453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:03.617804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2df15-2195-4e45-9b81-fd7bd45585f8 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:03.622422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 650/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 31 12:07:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:03.628204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:03.725465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cb7d49-954a-487b-bf35-a6ab4b614378 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:03.757557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:03.758139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:03.758413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:03.758799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] PATH_INFO: `/v3/services` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:03.759408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:03.759704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:03.761079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c098c-328a-4bb8-94ea-df5a9f211f80 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:03.765278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 642/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 31 12:07:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:07:05.635131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fb8ed-2aa8-454b-9ad2-65cd4566e2ef None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:05.635692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fb8ed-2aa8-454b-9ad2-65cd4566e2ef None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:05.635692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fb8ed-2aa8-454b-9ad2-65cd4566e2ef None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:05.637026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 651/1293] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:07:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:07:05.642041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853d13-71c5-4d85-bd13-cbb1608c17b5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:05.642428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853d13-71c5-4d85-bd13-cbb1608c17b5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:05.642591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef853d13-71c5-4d85-bd13-cbb1608c17b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:05.661174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ef853d13-71c5-4d85-bd13-cbb1608c17b5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:07:05.662362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ef853d13-71c5-4d85-bd13-cbb1608c17b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:07:05.690744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:05.727470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 643/1294] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:07:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:07:05.991673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fb8ed-2aa8-454b-9ad2-65cd4566e2ef None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:06.022607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:06.091669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27fb8ed-2aa8-454b-9ad2-65cd4566e2ef None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:06.124753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c55398-77fd-4f0f-a9d1-41db674cd39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:06.125335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55398-77fd-4f0f-a9d1-41db674cd39c None admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:06.125607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55398-77fd-4f0f-a9d1-41db674cd39c None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:06.125871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55398-77fd-4f0f-a9d1-41db674cd39c None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:06.126517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55398-77fd-4f0f-a9d1-41db674cd39c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:06.127861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55398-77fd-4f0f-a9d1-41db674cd39c None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:06.141587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 652/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Aug 31 12:07:05 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:07:08.049718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cd30-fdde-4a2b-bd54-e082760f5abc None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:08.050207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cd30-fdde-4a2b-bd54-e082760f5abc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:08.050299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40cd30-fdde-4a2b-bd54-e082760f5abc None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:08.051620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 644/1296] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:07:08.057387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:08.057819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:08.057939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:08.075777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:07:08.076994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:07:08.147235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 653/1297] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:07:08 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 31 12:07:08.426093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cd30-fdde-4a2b-bd54-e082760f5abc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:08.524402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40cd30-fdde-4a2b-bd54-e082760f5abc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:08.557058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:08.557672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:08.557951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:08.558221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:08.558788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:08.560176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:07:08.568682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:07:08.570109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:08.571535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 645/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:07:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:07:08.576458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:08.594125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:08.672946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13a26e-fccb-487e-941b-dd8c3897aa05 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:08.705771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:08.706307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:08.706583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:08.706850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:08.707468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:08.707765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:08.709211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:08.714209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 654/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 31 12:07:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:08.720246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:08.752213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:08.818424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f146f200-cc36-4451-924a-9744a15705dd None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:08.852187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:08.852786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:08.853062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:08.853326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:08.854012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] RBAC: Adding query filter params (interface=public, service_id=2b3c64700c1045ff986266925264a983, region_id=RegionOne) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:08.854312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:08.855661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5066f-9128-44a0-98cd-5bd9d175700b None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:08.860478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 646/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Aug 31 12:07:08 2022] GET /identity/v3/endpoints?service_id=2b3c64700c1045ff986266925264a983&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:08.866081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:08.945631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:08.964874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37733e5a-dded-4f08-9b1b-c73e125c5115 None admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:08.997422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5d681-251e-4ecd-9465-35381c91da4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:08.998010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d681-251e-4ecd-9465-35381c91da4e None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:08.998287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d681-251e-4ecd-9465-35381c91da4e None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:08.998557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5d681-251e-4ecd-9465-35381c91da4e None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:08.999146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5d681-251e-4ecd-9465-35381c91da4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:09.000530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5d681-251e-4ecd-9465-35381c91da4e None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:09.007042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 655/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Aug 31 12:07:08 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:07:10.893207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02867b-0ea7-479f-9b2b-382bf93d3f3f None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:10.893759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02867b-0ea7-479f-9b2b-382bf93d3f3f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:10.893759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02867b-0ea7-479f-9b2b-382bf93d3f3f None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:10.895109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 647/1302] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:07:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:07:10.900826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:10.901252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:10.901402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:10.919649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:07:10.920865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:07:10.985827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 656/1303] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:07:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 31 12:07:11.263924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02867b-0ea7-479f-9b2b-382bf93d3f3f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:11.360552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:11.368111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02867b-0ea7-479f-9b2b-382bf93d3f3f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:11.400578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:11.401204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:11.401485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:11.401756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:11.402324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:11.403693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 31 12:07:11.412388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 31 12:07:11.413556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.get_or_create( Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application with Lock( Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self._enter() Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application return self.creator() Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application created_value = creator( Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: ERROR keystone.server.flask.application Aug 31 12:07:11.414456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 648/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Aug 31 12:07:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 31 12:07:11.419452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:11.493132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:11.515792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fcfb6-be8f-4da3-acf3-ad6a1476a9c0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:11.547575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:11.548190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:11.548473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:11.548747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] PATH_INFO: `/v3/services` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:11.549387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:07:11.549672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:11.551046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed71976-43fa-4dc1-933a-42c975e3b398 None admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:11.556508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 657/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Aug 31 12:07:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:07:11.562296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:07:11.660184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fdd2c-24a0-44b6-a8a6-602ea5a5c6e0 None admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:07:11.692827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29acb9c-8f56-4135-96fa-4a6e3857c554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:07:11.693416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29acb9c-8f56-4135-96fa-4a6e3857c554 None admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:07:11.693694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29acb9c-8f56-4135-96fa-4a6e3857c554 None admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:07:11.694226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29acb9c-8f56-4135-96fa-4a6e3857c554 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:07:11.694877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29acb9c-8f56-4135-96fa-4a6e3857c554 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:07:11.696773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29acb9c-8f56-4135-96fa-4a6e3857c554 None admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:07:11.716474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 649/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:07:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:07:21.553054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=30 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:07:21.711873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:14.880532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d411-284e-4ae2-99b5-4fd22177b72a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:14.880969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d411-284e-4ae2-99b5-4fd22177b72a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:14.881112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125d411-284e-4ae2-99b5-4fd22177b72a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:14.886351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 658/1307] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:14.887861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496bc39-7d5d-44c9-b582-f96783f57a79 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:14.888360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496bc39-7d5d-44c9-b582-f96783f57a79 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:14.888456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496bc39-7d5d-44c9-b582-f96783f57a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:15.000968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8496bc39-7d5d-44c9-b582-f96783f57a79 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:15.002548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8496bc39-7d5d-44c9-b582-f96783f57a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:15.131997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 650/1308] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:08:15.463575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dd11-56a9-4bdc-91ca-c496ab1c0bf9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:15.464058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dd11-56a9-4bdc-91ca-c496ab1c0bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:15.464442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9dd11-56a9-4bdc-91ca-c496ab1c0bf9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:15.465964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 659/1309] 10.222.0.48 () {54 vars in 965 bytes} [Wed Aug 31 12:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:15.472010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a962c7-7a41-48ff-86ee-6dad4a01048c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:15.472406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a962c7-7a41-48ff-86ee-6dad4a01048c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:15.472786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a962c7-7a41-48ff-86ee-6dad4a01048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:15.561847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-21a962c7-7a41-48ff-86ee-6dad4a01048c None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:15.563096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21a962c7-7a41-48ff-86ee-6dad4a01048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:15.588871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:15.654266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 651/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Aug 31 12:08:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:08:15.664062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dd11-56a9-4bdc-91ca-c496ab1c0bf9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:15.665824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e1c9dd11-56a9-4bdc-91ca-c496ab1c0bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:15.780005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9dd11-56a9-4bdc-91ca-c496ab1c0bf9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:15.855409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:15.856055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:15.856335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:15.856602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:15.858181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:15.914283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:15.980599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:15.982248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e52916-0900-4bbf-9923-5f9b65ef4ddc service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:16.002152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 660/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:18.192465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd52957-d651-4957-bfdc-b42ae6407ece None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:18.193764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd52957-d651-4957-bfdc-b42ae6407ece None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:18.193764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd52957-d651-4957-bfdc-b42ae6407ece None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:18.195269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 652/1312] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:18.200464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349cf8-958e-4f73-b541-f5745cbe794b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:18.200887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349cf8-958e-4f73-b541-f5745cbe794b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:18.200998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc349cf8-958e-4f73-b541-f5745cbe794b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:18.275652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bc349cf8-958e-4f73-b541-f5745cbe794b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:18.276417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bc349cf8-958e-4f73-b541-f5745cbe794b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:18.384438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 661/1313] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:18.679610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee652-8340-45b6-a4cb-d5a7e0eb4367 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:18.680030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee652-8340-45b6-a4cb-d5a7e0eb4367 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:18.680379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ee652-8340-45b6-a4cb-d5a7e0eb4367 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:18.681808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 653/1314] 10.222.0.48 () {54 vars in 965 bytes} [Wed Aug 31 12:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:18.688148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fc92b-701a-42fd-bbbc-24192a620fc1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:18.688499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fc92b-701a-42fd-bbbc-24192a620fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:18.688836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fc92b-701a-42fd-bbbc-24192a620fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:18.701485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:18.767592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-564fc92b-701a-42fd-bbbc-24192a620fc1 None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:18.768834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-564fc92b-701a-42fd-bbbc-24192a620fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:18.844779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 662/1315] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Aug 31 12:08:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:18.854105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee652-8340-45b6-a4cb-d5a7e0eb4367 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:18.855626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c07ee652-8340-45b6-a4cb-d5a7e0eb4367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:18.962189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ee652-8340-45b6-a4cb-d5a7e0eb4367 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:19.031914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:19.034903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:19.035736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:19.036224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:19.037245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:19.038877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:19.148026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:19.149527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4473e4b0-301d-40c8-a576-303cb73aadbe service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:19.168535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 654/1316] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:21.604693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7358-9dfb-4058-bb90-6dd8a8e6bd5c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:21.605256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7358-9dfb-4058-bb90-6dd8a8e6bd5c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:21.605256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde7358-9dfb-4058-bb90-6dd8a8e6bd5c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:21.606577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 663/1317] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:21.611712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd2dc-dfb9-4fab-92d1-11024b5cdc92 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:21.612159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd2dc-dfb9-4fab-92d1-11024b5cdc92 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:21.612324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bd2dc-dfb9-4fab-92d1-11024b5cdc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:21.676124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b35bd2dc-dfb9-4fab-92d1-11024b5cdc92 None None] MFA Rules not processed for user `06f394ef75aa4bb29baa1d6359d2a84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:21.677926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b35bd2dc-dfb9-4fab-92d1-11024b5cdc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:21.728359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:21.771453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 655/1318] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:22.062141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde7358-9dfb-4058-bb90-6dd8a8e6bd5c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:22.063700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bbde7358-9dfb-4058-bb90-6dd8a8e6bd5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:22.164967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde7358-9dfb-4058-bb90-6dd8a8e6bd5c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:22.167706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:22.236487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:22.237013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:22.237287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:22.237552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:22.239114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:22.349941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:22.351368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ff2fee-36c9-4dd7-821f-19f3a4bab4b3 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:22.370316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 664/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:24.811825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a9f0-1339-4492-bfab-bdd0ac8e0d57 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:24.812417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a9f0-1339-4492-bfab-bdd0ac8e0d57 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:24.812417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f655a9f0-1339-4492-bfab-bdd0ac8e0d57 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:24.813768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 656/1320] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:24.819925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ab369-4b3f-4e47-94ec-1c5fe5355cd1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:24.820355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ab369-4b3f-4e47-94ec-1c5fe5355cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:24.820469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ab369-4b3f-4e47-94ec-1c5fe5355cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:24.859875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:24.884756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cf0ab369-4b3f-4e47-94ec-1c5fe5355cd1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:24.885949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cf0ab369-4b3f-4e47-94ec-1c5fe5355cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:24.980643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 665/1321] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:25.274979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a9f0-1339-4492-bfab-bdd0ac8e0d57 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:25.276560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f655a9f0-1339-4492-bfab-bdd0ac8e0d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:25.378788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f655a9f0-1339-4492-bfab-bdd0ac8e0d57 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:25.450572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:25.451171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:25.451447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:25.451714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:25.453325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:25.460579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:25.560223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:25.561660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc6431-5350-4224-af6a-2e33eaf43bcb service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:25.579980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 657/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:28.446557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a82583-3d2c-4de7-a018-0c24f067c2d3 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:28.447114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a82583-3d2c-4de7-a018-0c24f067c2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:28.447114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a82583-3d2c-4de7-a018-0c24f067c2d3 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:28.448640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 666/1323] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:28.453841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23e8a-ff58-479f-9814-8d804326f777 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:28.454245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23e8a-ff58-479f-9814-8d804326f777 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:28.454520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb23e8a-ff58-479f-9814-8d804326f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:28.521869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5cb23e8a-ff58-479f-9814-8d804326f777 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:28.523104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5cb23e8a-ff58-479f-9814-8d804326f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:28.580023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:28.628955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 658/1324] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:28.910441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a82583-3d2c-4de7-a018-0c24f067c2d3 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:28.912022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-00a82583-3d2c-4de7-a018-0c24f067c2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:29.017283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a82583-3d2c-4de7-a018-0c24f067c2d3 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:29.029114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:29.091654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:29.092299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:29.092578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:29.092850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:29.094436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:29.206957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:29.208391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94dd387-1d5c-4555-bf5d-e6da791edd18 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:29.227053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 667/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:08:31.196654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee9f75-fab8-4456-b6d8-978c1c1de125 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:31.197193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee9f75-fab8-4456-b6d8-978c1c1de125 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:31.197193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee9f75-fab8-4456-b6d8-978c1c1de125 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:31.198588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 659/1326] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:31.203845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9988a5-6a27-43dc-ae90-6aeab58c8fc7 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:31.204298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9988a5-6a27-43dc-ae90-6aeab58c8fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:31.204489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9988a5-6a27-43dc-ae90-6aeab58c8fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:31.252412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:31.271290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0f9988a5-6a27-43dc-ae90-6aeab58c8fc7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:31.272514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0f9988a5-6a27-43dc-ae90-6aeab58c8fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:31.368421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 668/1327] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:08:31.672209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee9f75-fab8-4456-b6d8-978c1c1de125 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:31.673847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7ee9f75-fab8-4456-b6d8-978c1c1de125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:31.780011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee9f75-fab8-4456-b6d8-978c1c1de125 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:31.857649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:31.858255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:31.858536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:31.858807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:31.860430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:31.878013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:31.974989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:31.976465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa3a166-9d93-47fb-95f4-3f916b3eba16 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:31.994532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 660/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:33.989722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947b235-121c-40ee-8c2b-cd36f926b387 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:33.990260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947b235-121c-40ee-8c2b-cd36f926b387 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:33.990260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947b235-121c-40ee-8c2b-cd36f926b387 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:33.991762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 669/1329] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:33.996776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd5b9-3eeb-4225-809c-61b2a7ce4d60 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:33.997207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd5b9-3eeb-4225-809c-61b2a7ce4d60 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:33.997362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fd5b9-3eeb-4225-809c-61b2a7ce4d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:34.062893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-492fd5b9-3eeb-4225-809c-61b2a7ce4d60 None None] MFA Rules not processed for user `06f394ef75aa4bb29baa1d6359d2a84f`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:34.064142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-492fd5b9-3eeb-4225-809c-61b2a7ce4d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:34.130588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:34.165801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 661/1330] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:33 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:34.454602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947b235-121c-40ee-8c2b-cd36f926b387 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:34.456850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7947b235-121c-40ee-8c2b-cd36f926b387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:34.566370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947b235-121c-40ee-8c2b-cd36f926b387 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:34.588033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:34.644949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:34.646109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:34.646385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:34.646652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:34.648268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:34.761907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:34.763387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80565e3-ba8a-40fe-a991-126f0213b70f service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:34.781729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 670/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:36.925657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde413e-fca8-48bc-a3cf-6ae6937802d6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:36.926193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde413e-fca8-48bc-a3cf-6ae6937802d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:36.926309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde413e-fca8-48bc-a3cf-6ae6937802d6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:36.927577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 662/1332] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:36.932578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd79aed-8442-46cd-a7fa-2631a4f8e3f5 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:36.933011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd79aed-8442-46cd-a7fa-2631a4f8e3f5 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:36.933129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd79aed-8442-46cd-a7fa-2631a4f8e3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:36.995151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:36.998142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ddd79aed-8442-46cd-a7fa-2631a4f8e3f5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:36.999816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ddd79aed-8442-46cd-a7fa-2631a4f8e3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:37.094553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 671/1333] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:37.383046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde413e-fca8-48bc-a3cf-6ae6937802d6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:37.384601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9cde413e-fca8-48bc-a3cf-6ae6937802d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:37.497056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde413e-fca8-48bc-a3cf-6ae6937802d6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:37.570646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:37.571242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:37.571516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:37.571784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:37.573388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:37.599550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:37.679366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:37.680739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76abd213-5526-4ff2-9f67-6fae9a312d66 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:37.698646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 663/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:39.664010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e3a02-bafb-474f-81e1-afcc8a9b8abc None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:39.664597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e3a02-bafb-474f-81e1-afcc8a9b8abc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:39.664597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e3a02-bafb-474f-81e1-afcc8a9b8abc None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:39.665904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 672/1335] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:39.671017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130af3-bb65-4e75-a6ef-4b203c9982a9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:39.671463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130af3-bb65-4e75-a6ef-4b203c9982a9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:39.671584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130af3-bb65-4e75-a6ef-4b203c9982a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:39.736448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b1130af3-bb65-4e75-a6ef-4b203c9982a9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:39.737636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b1130af3-bb65-4e75-a6ef-4b203c9982a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:39.808560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:39.831650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 664/1336] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:40.122909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e3a02-bafb-474f-81e1-afcc8a9b8abc None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:40.124863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a03e3a02-bafb-474f-81e1-afcc8a9b8abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:40.227527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e3a02-bafb-474f-81e1-afcc8a9b8abc None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:40.257269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:40.305330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:40.305946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:40.306229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:40.306507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:40.308132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:40.418059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:40.419512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4130c65c-77cd-4956-a5e7-e68b81fd70f3 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:40.438209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 673/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:42.804640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44a35-5aff-457f-9c0d-2bd983b16180 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:42.805201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44a35-5aff-457f-9c0d-2bd983b16180 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:42.805201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c44a35-5aff-457f-9c0d-2bd983b16180 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:42.806526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 665/1338] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:42.811731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53261-ee38-45d7-b1be-649b0d00f8a8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:42.812196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53261-ee38-45d7-b1be-649b0d00f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:42.812312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e53261-ee38-45d7-b1be-649b0d00f8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:42.876990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-00e53261-ee38-45d7-b1be-649b0d00f8a8 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:42.878200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-00e53261-ee38-45d7-b1be-649b0d00f8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:42.886755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:42.976018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 674/1339] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:43.271466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44a35-5aff-457f-9c0d-2bd983b16180 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:43.273056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-52c44a35-5aff-457f-9c0d-2bd983b16180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:43.378466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c44a35-5aff-457f-9c0d-2bd983b16180 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:43.454813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:43.455418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:43.455697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:43.455991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:43.458273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:43.493741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:43.568086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:43.569549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c3f5d-2c1f-4cba-9f33-d90ee089d229 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:43.587940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 666/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:08:47.439496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdd3f8-5207-44c2-b16a-ef4ad9e30dc4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:47.440052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdd3f8-5207-44c2-b16a-ef4ad9e30dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:47.440052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdd3f8-5207-44c2-b16a-ef4ad9e30dc4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:47.441395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 675/1341] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:47.446748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea66b-2124-4338-8e32-74d0921963b3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:47.447200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea66b-2124-4338-8e32-74d0921963b3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:47.447317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ea66b-2124-4338-8e32-74d0921963b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:47.516266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7b5ea66b-2124-4338-8e32-74d0921963b3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:47.517486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b5ea66b-2124-4338-8e32-74d0921963b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:47.605963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:47.618096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 667/1342] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:47.901110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdd3f8-5207-44c2-b16a-ef4ad9e30dc4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:47.902787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-87fdd3f8-5207-44c2-b16a-ef4ad9e30dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:48.010689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdd3f8-5207-44c2-b16a-ef4ad9e30dc4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:48.052815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:48.090303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:48.090905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:48.091186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:48.091458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:48.093088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:48.202806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:48.204189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef0713-57ad-4820-abd9-aedd1d0490fb service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:48.222780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 676/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:08:50.709600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40d2e-9030-4a73-ade6-7184caf6f5e4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:50.710153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40d2e-9030-4a73-ade6-7184caf6f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:50.710153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf40d2e-9030-4a73-ade6-7184caf6f5e4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:50.711525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 668/1344] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:50.717198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6cb1-d71c-49f4-847b-252a3e9f5004 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:50.717696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6cb1-d71c-49f4-847b-252a3e9f5004 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:50.717791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b6cb1-d71c-49f4-847b-252a3e9f5004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:50.791960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-693b6cb1-d71c-49f4-847b-252a3e9f5004 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:50.793197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-693b6cb1-d71c-49f4-847b-252a3e9f5004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:50.811468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:50.891808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 677/1345] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:51.179239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40d2e-9030-4a73-ade6-7184caf6f5e4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:51.181407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-edf40d2e-9030-4a73-ade6-7184caf6f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:51.289612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf40d2e-9030-4a73-ade6-7184caf6f5e4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:51.363110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:51.364249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:51.364522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:51.364779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:51.366348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:51.415500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:51.483057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:51.484450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3303c88-9081-4fbd-958f-23f95b34a767 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:51.502988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 669/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:08:55.483563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687ce5a-bc82-41b9-9623-f7c35efd5037 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:55.484109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687ce5a-bc82-41b9-9623-f7c35efd5037 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:55.484193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687ce5a-bc82-41b9-9623-f7c35efd5037 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:55.485550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 678/1347] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:08:55.491628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85e82-b5d9-41d4-9d93-b9c76a32fa75 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:55.492212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85e82-b5d9-41d4-9d93-b9c76a32fa75 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:55.492212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce85e82-b5d9-41d4-9d93-b9c76a32fa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:55.566708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dce85e82-b5d9-41d4-9d93-b9c76a32fa75 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:08:55.568229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dce85e82-b5d9-41d4-9d93-b9c76a32fa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:55.674008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:55.677509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 670/1348] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:08:55.959117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687ce5a-bc82-41b9-9623-f7c35efd5037 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:08:55.960680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b687ce5a-bc82-41b9-9623-f7c35efd5037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:56.068864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687ce5a-bc82-41b9-9623-f7c35efd5037 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:08:56.117537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:08:56.144132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:08:56.145390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:08:56.145668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:08:56.145939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:08:56.147524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:08:56.253605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:08:56.255500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55934-de3f-4649-be12-6cec6de04e4a service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:08:56.275582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 679/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:01.179004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87b13-8df0-4b05-b05c-ef9bcdd6b003 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:01.179495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87b13-8df0-4b05-b05c-ef9bcdd6b003 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:01.179587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee87b13-8df0-4b05-b05c-ef9bcdd6b003 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:01.181262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 671/1350] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:01.188285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da091-94f7-48cc-bb34-2cea9b6a317b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:01.189155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da091-94f7-48cc-bb34-2cea9b6a317b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:01.189648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064da091-94f7-48cc-bb34-2cea9b6a317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:01.276443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-064da091-94f7-48cc-bb34-2cea9b6a317b None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:01.277660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-064da091-94f7-48cc-bb34-2cea9b6a317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:01.297809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:01.449884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 680/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:09:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:05.617737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f8a57-3866-46fe-b4c9-0f8427a41ab9 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:05.618303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f8a57-3866-46fe-b4c9-0f8427a41ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:05.618303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f8a57-3866-46fe-b4c9-0f8427a41ab9 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:05.619821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 672/1352] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:09:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:05.624778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8f118-bc28-48d7-914b-92090c48af55 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:05.625577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8f118-bc28-48d7-914b-92090c48af55 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:05.626034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8f118-bc28-48d7-914b-92090c48af55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:05.726503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-97e8f118-bc28-48d7-914b-92090c48af55 None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:05.729310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-97e8f118-bc28-48d7-914b-92090c48af55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:05.809266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:05.851715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 681/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:09:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:07.231760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa0da-1bca-4c10-99aa-7aa468ce17d8 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:07.232278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa0da-1bca-4c10-99aa-7aa468ce17d8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:07.232278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25aa0da-1bca-4c10-99aa-7aa468ce17d8 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:07.233787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 673/1354] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:07.239495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1615ec-f6cd-4ac0-8b9f-0e3249198c1d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:07.239914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1615ec-f6cd-4ac0-8b9f-0e3249198c1d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:07.240188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1615ec-f6cd-4ac0-8b9f-0e3249198c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:07.315524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cb1615ec-f6cd-4ac0-8b9f-0e3249198c1d None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:07.317395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb1615ec-f6cd-4ac0-8b9f-0e3249198c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:07.429418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 682/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:09:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:09:10.765738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f9ea-b038-46bf-bddd-6edbcded3469 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:10.768447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f9ea-b038-46bf-bddd-6edbcded3469 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:10.768447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f9ea-b038-46bf-bddd-6edbcded3469 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:10.769776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 674/1356] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:10 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:10.775484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271c7c-717c-45b4-ac5e-b3355b4fc60f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:10.776027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271c7c-717c-45b4-ac5e-b3355b4fc60f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:10.776144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271c7c-717c-45b4-ac5e-b3355b4fc60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:10.816601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:10.859725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-22271c7c-717c-45b4-ac5e-b3355b4fc60f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:10.861145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-22271c7c-717c-45b4-ac5e-b3355b4fc60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:10.984569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 683/1357] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:11.281466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12bde-ba6b-4628-8dfc-a4f6cfa4b178 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:11.282238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12bde-ba6b-4628-8dfc-a4f6cfa4b178 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:11.282945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c12bde-ba6b-4628-8dfc-a4f6cfa4b178 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:11.285298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 675/1358] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 31 12:09:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:11.293730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf848-6137-41d3-be2d-283b5b5a9e2f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:11.294040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf848-6137-41d3-be2d-283b5b5a9e2f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:11.294311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fcf848-6137-41d3-be2d-283b5b5a9e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:11.378085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e1fcf848-6137-41d3-be2d-283b5b5a9e2f None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:11.379772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e1fcf848-6137-41d3-be2d-283b5b5a9e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:11.430621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:11.504129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 684/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 31 12:09:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:11.511840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c12bde-ba6b-4628-8dfc-a4f6cfa4b178 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:11.515361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-97c12bde-ba6b-4628-8dfc-a4f6cfa4b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:11.667722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c12bde-ba6b-4628-8dfc-a4f6cfa4b178 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:11.744472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:11.789045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:11.789768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:11.790228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:11.790600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:11.792338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:11.885934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:11.887684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e612af-a5c1-4422-ad2d-76a026d582bc service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:11.906758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 676/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:14.036264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfa9b-0d5b-45b3-a7a3-8b63fd1c2248 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:14.036854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfa9b-0d5b-45b3-a7a3-8b63fd1c2248 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:14.036854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6dfa9b-0d5b-45b3-a7a3-8b63fd1c2248 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:14.038340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 685/1361] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:14.043545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac933a-ec5e-4e6b-b2e3-b03ce96a4d2e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:14.044146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac933a-ec5e-4e6b-b2e3-b03ce96a4d2e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:14.044146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac933a-ec5e-4e6b-b2e3-b03ce96a4d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:14.119373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2bac933a-ec5e-4e6b-b2e3-b03ce96a4d2e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:14.120801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2bac933a-ec5e-4e6b-b2e3-b03ce96a4d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:14.163678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:14.239837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 677/1362] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:09:14.532292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dfa9b-0d5b-45b3-a7a3-8b63fd1c2248 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:14.532292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4b6dfa9b-0d5b-45b3-a7a3-8b63fd1c2248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:14.684146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6dfa9b-0d5b-45b3-a7a3-8b63fd1c2248 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:14.695571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:14.808434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:14.809212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:14.809731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:14.810134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:14.811863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:14.916987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:14.918645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c48a-c983-4e82-b60e-4da1672b428d service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:14.938593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 686/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:17.175452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d5f05-c38f-45a9-8a2b-f3f59a6d6c63 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:17.176049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d5f05-c38f-45a9-8a2b-f3f59a6d6c63 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:17.176049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d5f05-c38f-45a9-8a2b-f3f59a6d6c63 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:17.177404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 678/1364] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:17.182792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef808f-a36e-4d93-bc88-330373421e13 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:17.183210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef808f-a36e-4d93-bc88-330373421e13 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:17.183313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aef808f-a36e-4d93-bc88-330373421e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:17.204093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:17.258607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0aef808f-a36e-4d93-bc88-330373421e13 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:17.259748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0aef808f-a36e-4d93-bc88-330373421e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:17.364643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 687/1365] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:17.661592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbca24-f85b-4214-a934-42035df48984 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:17.662122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbca24-f85b-4214-a934-42035df48984 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:17.662345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbca24-f85b-4214-a934-42035df48984 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:17.664157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 679/1366] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 31 12:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:17.670155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec05497-7091-461f-bf39-be1d71f0f0e0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:17.670443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec05497-7091-461f-bf39-be1d71f0f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:17.670713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec05497-7091-461f-bf39-be1d71f0f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:17.750006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4ec05497-7091-461f-bf39-be1d71f0f0e0 None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:17.751205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4ec05497-7091-461f-bf39-be1d71f0f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:17.787377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:17.875916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 688/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 31 12:09:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:17.883725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbca24-f85b-4214-a934-42035df48984 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:17.885272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-03cbca24-f85b-4214-a934-42035df48984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:18.045665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbca24-f85b-4214-a934-42035df48984 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:18.066807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:18.174837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:18.175452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:18.175729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:18.176323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:18.177592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:18.270065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:18.271647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe288ce8-43df-4d47-bc5e-067b72cdbc65 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:18.294569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 680/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:18.929580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60ff9-a49b-4702-8312-f13a330087b6 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:18.930145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60ff9-a49b-4702-8312-f13a330087b6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:18.930145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d60ff9-a49b-4702-8312-f13a330087b6 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:18.931733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 689/1369] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:18.937023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d683d-25b1-43f0-aa7d-dff8e3084601 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:18.937315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d683d-25b1-43f0-aa7d-dff8e3084601 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:18.937587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d683d-25b1-43f0-aa7d-dff8e3084601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:18.970671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:19.007516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d40d683d-25b1-43f0-aa7d-dff8e3084601 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:19.008790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d40d683d-25b1-43f0-aa7d-dff8e3084601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:19.112023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 681/1370] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:19.696637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08df85-a3bf-483f-99bb-11ca76154f8e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:19.696930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08df85-a3bf-483f-99bb-11ca76154f8e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:19.697184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08df85-a3bf-483f-99bb-11ca76154f8e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:19.698714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 690/1371] 10.222.0.48 () {54 vars in 964 bytes} [Wed Aug 31 12:09:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:19.704697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe14fb-f85e-4f8d-8233-803f46690de6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:19.704697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe14fb-f85e-4f8d-8233-803f46690de6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:19.705294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfe14fb-f85e-4f8d-8233-803f46690de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:19.792877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ccfe14fb-f85e-4f8d-8233-803f46690de6 None None] MFA Rules not processed for user `5995bbc9449c472ca4f15fc9dddb2092`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:19.794236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ccfe14fb-f85e-4f8d-8233-803f46690de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:19.844973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:19.877324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 682/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Aug 31 12:09:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:19.885860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08df85-a3bf-483f-99bb-11ca76154f8e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:19.887357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9b08df85-a3bf-483f-99bb-11ca76154f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:19.999394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08df85-a3bf-483f-99bb-11ca76154f8e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:20.044262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:20.086401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:20.087196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:20.087598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:20.088029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:20.090092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:20.225853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:20.227537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e1391-9a45-4c7f-979d-7f40f1095281 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:20.252008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 691/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:20.340209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ff5d-2ceb-4b22-a533-ffb32a8bff48 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:20.340674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ff5d-2ceb-4b22-a533-ffb32a8bff48 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:20.340965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ff5d-2ceb-4b22-a533-ffb32a8bff48 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:20.342640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 683/1374] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:20.348280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff36e5-6ccf-4d8f-8a4d-ff5eb1263412 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:20.348898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff36e5-6ccf-4d8f-8a4d-ff5eb1263412 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:20.349176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff36e5-6ccf-4d8f-8a4d-ff5eb1263412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:20.446348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-15ff36e5-6ccf-4d8f-8a4d-ff5eb1263412 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:20.447550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-15ff36e5-6ccf-4d8f-8a4d-ff5eb1263412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:20.469122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:20.548059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 692/1375] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:20.837360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ff5d-2ceb-4b22-a533-ffb32a8bff48 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:20.839144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6528ff5d-2ceb-4b22-a533-ffb32a8bff48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:21.000028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ff5d-2ceb-4b22-a533-ffb32a8bff48 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:21.050625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:21.111007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:21.111536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:21.111810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:21.112108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:21.113702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:21.202508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:21.204125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76194fd0-ddac-4f79-a08d-e9c5bca7fbf0 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:21.227339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 684/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:23.173406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d44b7-c01c-4d4a-a7a9-3f39de8b3a30 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:23.173942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d44b7-c01c-4d4a-a7a9-3f39de8b3a30 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:23.173942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d44b7-c01c-4d4a-a7a9-3f39de8b3a30 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:23.175906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 693/1377] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:23.181115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d91e9-246b-4ea5-99d7-948bee4ade07 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:23.181505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d91e9-246b-4ea5-99d7-948bee4ade07 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:23.181665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d91e9-246b-4ea5-99d7-948bee4ade07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:23.255239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f93d91e9-246b-4ea5-99d7-948bee4ade07 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:23.256595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f93d91e9-246b-4ea5-99d7-948bee4ade07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:23.263352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:23.367287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 685/1378] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:23.664095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d44b7-c01c-4d4a-a7a9-3f39de8b3a30 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:23.665594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b29d44b7-c01c-4d4a-a7a9-3f39de8b3a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:23.851809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d44b7-c01c-4d4a-a7a9-3f39de8b3a30 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:23.857547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:23.983460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:23.984103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:23.984499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:23.984789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:23.986379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:24.086328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:24.088166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92fb12-bde8-4c9a-96ba-56e39a578fff service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:24.107099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 694/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:26.063264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73498cc-0760-47c8-983d-a6d492707c0b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:26.063794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73498cc-0760-47c8-983d-a6d492707c0b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:26.063794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73498cc-0760-47c8-983d-a6d492707c0b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:26.068335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 686/1380] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:26.071381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898d01-db6a-4592-bc9c-727d070a17bf None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:26.071773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898d01-db6a-4592-bc9c-727d070a17bf None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:26.072026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1898d01-db6a-4592-bc9c-727d070a17bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:26.089823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:26.151261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b1898d01-db6a-4592-bc9c-727d070a17bf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:26.152579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b1898d01-db6a-4592-bc9c-727d070a17bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:26.267515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 695/1381] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:26.554297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73498cc-0760-47c8-983d-a6d492707c0b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:26.556374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c73498cc-0760-47c8-983d-a6d492707c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:26.714176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:26.727878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73498cc-0760-47c8-983d-a6d492707c0b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:26.854427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:26.855183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:26.855521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:26.855854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:26.857570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:26.957960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:26.959844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c57d56-de3d-42c0-b03f-61cda8f736c7 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:26.971338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:26.991104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 687/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:29.020226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4845e-b6fd-45af-bb61-867100452df2 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:29.020805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4845e-b6fd-45af-bb61-867100452df2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:29.020949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb4845e-b6fd-45af-bb61-867100452df2 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:29.022680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 696/1383] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:29.028253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf95bf-a136-454c-9ca3-bffa4dedcd97 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:29.028690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf95bf-a136-454c-9ca3-bffa4dedcd97 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:29.028800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf95bf-a136-454c-9ca3-bffa4dedcd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:29.095473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cfaf95bf-a136-454c-9ca3-bffa4dedcd97 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:29.097196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cfaf95bf-a136-454c-9ca3-bffa4dedcd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:29.200531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 688/1384] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:29.492605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4845e-b6fd-45af-bb61-867100452df2 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:29.494201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fcb4845e-b6fd-45af-bb61-867100452df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:29.584773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:29.646360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb4845e-b6fd-45af-bb61-867100452df2 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:29.768173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:29.769201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:29.769474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:29.769743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:29.771337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:29.820475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:29.861078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:29.862725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739a2e1-eabf-4f55-b106-d6fd14e012ac service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:29.880958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 697/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:31.851540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef2cb3-4a4d-4847-810b-5368b9ed156d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:31.852094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef2cb3-4a4d-4847-810b-5368b9ed156d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:31.852187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef2cb3-4a4d-4847-810b-5368b9ed156d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:31.853655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 689/1386] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:31.860709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d3735-ff6a-4b56-b773-ef8785d8731c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:31.861127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d3735-ff6a-4b56-b773-ef8785d8731c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:31.861396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d3735-ff6a-4b56-b773-ef8785d8731c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:31.941909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-de4d3735-ff6a-4b56-b773-ef8785d8731c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:31.943380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-de4d3735-ff6a-4b56-b773-ef8785d8731c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:32.040962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 698/1387] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:32.408819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef2cb3-4a4d-4847-810b-5368b9ed156d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:32.410438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-24ef2cb3-4a4d-4847-810b-5368b9ed156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:32.488048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:32.560499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef2cb3-4a4d-4847-810b-5368b9ed156d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:32.675979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:32.676582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:32.676858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:32.677124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:32.678709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:32.718095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:32.771869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:32.773558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58476dd1-9742-474a-83f9-123e4193e7fe service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:32.793158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 690/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:34.744949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07522636-d298-49c6-a53c-9b8921c6af2b None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:34.745534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07522636-d298-49c6-a53c-9b8921c6af2b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:34.745534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07522636-d298-49c6-a53c-9b8921c6af2b None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:34.746816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 699/1389] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:34.752144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227ceb-1af5-487d-a6f7-ee2c8432c6d6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:34.752583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227ceb-1af5-487d-a6f7-ee2c8432c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:34.752707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90227ceb-1af5-487d-a6f7-ee2c8432c6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:34.819871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-90227ceb-1af5-487d-a6f7-ee2c8432c6d6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:34.821138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-90227ceb-1af5-487d-a6f7-ee2c8432c6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:34.919980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 691/1390] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:35.212628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07522636-d298-49c6-a53c-9b8921c6af2b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:35.213401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba94a4a-af42-485e-8f96-b258810ae74d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:35.213689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba94a4a-af42-485e-8f96-b258810ae74d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:35.213963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba94a4a-af42-485e-8f96-b258810ae74d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:35.214161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-07522636-d298-49c6-a53c-9b8921c6af2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:35.215314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 692/1391] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:09:35.220265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e932a0-507d-4aa9-b4d9-7ec579fa9afb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:35.220552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e932a0-507d-4aa9-b4d9-7ec579fa9afb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:35.220826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e932a0-507d-4aa9-b4d9-7ec579fa9afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:35.237892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:35.246664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:35.290757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-10e932a0-507d-4aa9-b4d9-7ec579fa9afb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:35.292075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-10e932a0-507d-4aa9-b4d9-7ec579fa9afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:35.362841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07522636-d298-49c6-a53c-9b8921c6af2b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:35.393432 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 693/1392] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:09:35.467408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:35.479860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:35.480499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:35.480779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:35.481051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:35.482632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:35.571145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:35.572814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2229e6-5c0b-46b4-8448-04a7520f0a2f service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:35.590344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 700/1393] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:35.699210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382929-5172-4e3a-a5ab-49bc11cc2e3c None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:35.699500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382929-5172-4e3a-a5ab-49bc11cc2e3c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:35.699774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382929-5172-4e3a-a5ab-49bc11cc2e3c None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:35.701885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 694/1394] 10.222.0.48 () {54 vars in 967 bytes} [Wed Aug 31 12:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:35.707855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5221c7-2289-4104-8f70-bc93d431ccbf None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:35.709746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5221c7-2289-4104-8f70-bc93d431ccbf None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:35.709746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5221c7-2289-4104-8f70-bc93d431ccbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:35.792157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ac5221c7-2289-4104-8f70-bc93d431ccbf None None] MFA Rules not processed for user `8f9c000fb6194cbe8fe70841753c079c`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:35.793294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ac5221c7-2289-4104-8f70-bc93d431ccbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:35.845769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:35.870794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 701/1395] 10.222.0.48 () {58 vars in 1064 bytes} [Wed Aug 31 12:09:35 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:35.878302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382929-5172-4e3a-a5ab-49bc11cc2e3c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:35.879802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-68382929-5172-4e3a-a5ab-49bc11cc2e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:35.978017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:35.985558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382929-5172-4e3a-a5ab-49bc11cc2e3c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:36.058908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:36.059526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:36.059804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:36.060104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:36.061686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:36.171792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:36.173259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a29f01-4cd9-479b-9e1b-710872103eca service glance] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:36.191412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 695/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:36.925761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce5eb-77e1-4131-b215-c8a0eae1f947 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:36.926251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce5eb-77e1-4131-b215-c8a0eae1f947 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:36.926352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdce5eb-77e1-4131-b215-c8a0eae1f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:37.011440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-afdce5eb-77e1-4131-b215-c8a0eae1f947 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:37.012779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-afdce5eb-77e1-4131-b215-c8a0eae1f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:37.102440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 702/1397] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:09:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:37.144013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105152d-29f7-441f-b482-c8d62a933e67 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:37.144494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105152d-29f7-441f-b482-c8d62a933e67 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:37.144622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105152d-29f7-441f-b482-c8d62a933e67 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:37.145984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 696/1398] 10.222.0.48 () {54 vars in 943 bytes} [Wed Aug 31 12:09:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:37.152401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934717e-3df8-497d-a226-c4e45d5590d4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:37.152985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934717e-3df8-497d-a226-c4e45d5590d4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:37.153332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934717e-3df8-497d-a226-c4e45d5590d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:37.232972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9934717e-3df8-497d-a226-c4e45d5590d4 None None] MFA Rules not processed for user `08996d25b2614149a6bc71437c96b135`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:37.234090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9934717e-3df8-497d-a226-c4e45d5590d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:37.246722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:37.340339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 703/1399] 10.222.0.48 () {58 vars in 1040 bytes} [Wed Aug 31 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:09:37.349999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105152d-29f7-441f-b482-c8d62a933e67 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:37.351534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5105152d-29f7-441f-b482-c8d62a933e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:37.376989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:37.491844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105152d-29f7-441f-b482-c8d62a933e67 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:37.557747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1663394-d456-4b8f-a8d8-39332da260f9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:37.558033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1663394-d456-4b8f-a8d8-39332da260f9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:37.558304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1663394-d456-4b8f-a8d8-39332da260f9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:37.559669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 704/1400] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:09:37.564712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d246c1-be39-4382-a925-8a1bc52548a1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:37.565003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d246c1-be39-4382-a925-8a1bc52548a1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:37.565283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d246c1-be39-4382-a925-8a1bc52548a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:37.594219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:37.594836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:37.595094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:37.595360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:37.597062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:37.604685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:37.633741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d9d246c1-be39-4382-a925-8a1bc52548a1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:37.634931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d9d246c1-be39-4382-a925-8a1bc52548a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:37.681537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:37.683153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:37.692309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 697/1401] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:09:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:09:37.713308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:37.737951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 705/1402] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:09:38.032486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:38.033805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:38.143522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7bb669-76c5-4a82-a582-f5a4561e3449 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:38.203846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:38.268328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:38.269068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:38.269418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:38.269740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:38.271282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:38.371843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:38.373489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496739d6-7b5e-45c6-a4c6-10927248d46e service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:38.399007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 698/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:40.380719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1c40-f69a-4457-813c-0a1e9c0bdace None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:40.381303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1c40-f69a-4457-813c-0a1e9c0bdace None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:40.381303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e1c40-f69a-4457-813c-0a1e9c0bdace None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:40.388279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135e50-dd63-4296-ba3e-742afd2439c9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:40.388279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135e50-dd63-4296-ba3e-742afd2439c9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:40.388888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40135e50-dd63-4296-ba3e-742afd2439c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:40.392119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 706/1404] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:40.462391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-40135e50-dd63-4296-ba3e-742afd2439c9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:40.463634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-40135e50-dd63-4296-ba3e-742afd2439c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:40.479671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:40.578017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 699/1405] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:40.868439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1c40-f69a-4457-813c-0a1e9c0bdace None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:40.870076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-773e1c40-f69a-4457-813c-0a1e9c0bdace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:41.042857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e1c40-f69a-4457-813c-0a1e9c0bdace None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:41.120539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:41.305574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:41.306206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:41.306486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:41.306758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:41.308483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:41.407875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:41.410009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36273cf-dd33-409c-947e-1ceaa12c3a00 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:41.428879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 707/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:43.432111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3af1-9a6b-4206-9570-22c0535513cb None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:43.432699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3af1-9a6b-4206-9570-22c0535513cb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:43.432699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3af1-9a6b-4206-9570-22c0535513cb None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:43.434015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 700/1407] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:09:43.439791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9141e7-db15-4101-b30d-681c2ed04914 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:43.440780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9141e7-db15-4101-b30d-681c2ed04914 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:43.441219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9141e7-db15-4101-b30d-681c2ed04914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:43.515385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bf9141e7-db15-4101-b30d-681c2ed04914 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:09:43.517485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bf9141e7-db15-4101-b30d-681c2ed04914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:43.536591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:43.634723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 708/1408] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:09:44.002492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3af1-9a6b-4206-9570-22c0535513cb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:09:44.004256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-502a3af1-9a6b-4206-9570-22c0535513cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:44.185181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:44.188182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3af1-9a6b-4206-9570-22c0535513cb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:09:44.327047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:09:44.327657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:09:44.327931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:09:44.328232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:09:44.332043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:09:44.432396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:09:44.434836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06ae35-56d4-477e-8b68-8b24fdd741a7 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:09:44.454460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 701/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:09:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:09:53.632634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=35 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:09:54.452152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:00.005295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fe963-da80-449a-bc9c-2524481adbc7 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:00.005823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fe963-da80-449a-bc9c-2524481adbc7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:00.005942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fe963-da80-449a-bc9c-2524481adbc7 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:00.007342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 709/1410] 10.222.0.48 () {54 vars in 918 bytes} [Wed Aug 31 12:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:00.012390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed4063-2fa7-42a5-962f-a6fe5defd9c9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:00.012838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed4063-2fa7-42a5-962f-a6fe5defd9c9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:00.012949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed4063-2fa7-42a5-962f-a6fe5defd9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:00.088357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-93ed4063-2fa7-42a5-962f-a6fe5defd9c9 None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:00.089575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-93ed4063-2fa7-42a5-962f-a6fe5defd9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:00.194742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 702/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 31 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:00.209360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f83ac-ba03-4cc2-b639-3d74b6a83763 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:00.209586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f83ac-ba03-4cc2-b639-3d74b6a83763 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:00.209857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f83ac-ba03-4cc2-b639-3d74b6a83763 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:00.211230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 710/1412] 10.222.0.48 () {54 vars in 918 bytes} [Wed Aug 31 12:10:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:00.215841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a0954-e2d7-4a4d-aa6a-cd751e47727c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:00.216147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a0954-e2d7-4a4d-aa6a-cd751e47727c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:00.216417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a0954-e2d7-4a4d-aa6a-cd751e47727c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:00.287764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:00.290829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c78a0954-e2d7-4a4d-aa6a-cd751e47727c None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:00.292576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c78a0954-e2d7-4a4d-aa6a-cd751e47727c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:00.406130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 703/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Aug 31 12:10:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:10:02.795324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85172-68d6-43d4-bc10-c5850d0bd96e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:02.795892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85172-68d6-43d4-bc10-c5850d0bd96e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:02.795892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a85172-68d6-43d4-bc10-c5850d0bd96e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:02.797274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:02.803497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9532b-3569-428c-af86-33e6990eff10 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:02.803920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9532b-3569-428c-af86-33e6990eff10 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:02.804088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9532b-3569-428c-af86-33e6990eff10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:02.868680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-54c9532b-3569-428c-af86-33e6990eff10 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:02.869867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-54c9532b-3569-428c-af86-33e6990eff10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:02.924107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:02.967234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:03.255027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85172-68d6-43d4-bc10-c5850d0bd96e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:03.256703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a4a85172-68d6-43d4-bc10-c5850d0bd96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:03.405535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a85172-68d6-43d4-bc10-c5850d0bd96e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:03.476599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:03.516094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:03.516624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:03.516898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:03.517161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:03.518763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:03.605267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:03.606840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aca29a-294d-4a51-973a-d7a7ef6dc1a9 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:03.624892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 712/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:04.507855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcd413-c268-4fdf-82be-7ace0e0432d6 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:04.508401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcd413-c268-4fdf-82be-7ace0e0432d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:04.508537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dcd413-c268-4fdf-82be-7ace0e0432d6 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:04.509826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:04.514744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893099-f914-44c9-b498-c73d391d9b19 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:04.515172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893099-f914-44c9-b498-c73d391d9b19 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:04.515289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18893099-f914-44c9-b498-c73d391d9b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:04.591158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-18893099-f914-44c9-b498-c73d391d9b19 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:04.592391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-18893099-f914-44c9-b498-c73d391d9b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:04.618442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:04.685760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:04.836430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcd413-c268-4fdf-82be-7ace0e0432d6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:04.838025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e2dcd413-c268-4fdf-82be-7ace0e0432d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:04.982471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dcd413-c268-4fdf-82be-7ace0e0432d6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:05.021463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:05.094007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:05.094611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:05.094887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:05.095154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:05.096796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:05.183669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:05.185337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc296284-1f0c-4db5-9791-aebf4d818af1 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:05.204112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 706/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:06.086782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1495-c954-4fc3-9c53-c5c42d674c89 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:06.087334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1495-c954-4fc3-9c53-c5c42d674c89 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:06.087334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd1495-c954-4fc3-9c53-c5c42d674c89 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:06.088799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:06.093658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4e78-5cb3-4da4-a08e-6e815d9ea522 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:06.094076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4e78-5cb3-4da4-a08e-6e815d9ea522 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:06.094217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4e78-5cb3-4da4-a08e-6e815d9ea522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:06.147846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:06.169885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6ead4e78-5cb3-4da4-a08e-6e815d9ea522 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:06.171081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ead4e78-5cb3-4da4-a08e-6e815d9ea522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:06.266665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:06.416616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1495-c954-4fc3-9c53-c5c42d674c89 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:06.418103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-47fd1495-c954-4fc3-9c53-c5c42d674c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:06.560539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd1495-c954-4fc3-9c53-c5c42d674c89 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:06.572979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:06.676033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:06.676666 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:06.676944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:06.677215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:06.678816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:06.766296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:06.767925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568dd68-b5e5-4a2d-993d-c0862e0f9092 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:06.786001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 715/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:07.646039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87631b4-9fbb-4828-be95-ead39723c27a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:07.646621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87631b4-9fbb-4828-be95-ead39723c27a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:07.646621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87631b4-9fbb-4828-be95-ead39723c27a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:07.647923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:07.652795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b244447-19d1-485a-9871-f07583be8f5f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:07.653186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b244447-19d1-485a-9871-f07583be8f5f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:07.653338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b244447-19d1-485a-9871-f07583be8f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:07.672904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:07.729640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2b244447-19d1-485a-9871-f07583be8f5f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:07.730846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2b244447-19d1-485a-9871-f07583be8f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:07.826912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:07.979655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87631b4-9fbb-4828-be95-ead39723c27a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:07.981213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e87631b4-9fbb-4828-be95-ead39723c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:08.088771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:08.124466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87631b4-9fbb-4828-be95-ead39723c27a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:08.243756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:08.244393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:08.244673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:08.244942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:08.246544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:08.321814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:08.335938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:08.337560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd576e0-cffe-411d-8a60-1bcb7e63d160 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:08.356100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 709/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:09.214941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fda73-7b8b-4e4b-9fc1-ce005130b83e None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:09.215455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fda73-7b8b-4e4b-9fc1-ce005130b83e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:09.215455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92fda73-7b8b-4e4b-9fc1-ce005130b83e None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:09.216895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:09.221705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02c7bd-46ee-407d-8169-489551751a16 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:09.222144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02c7bd-46ee-407d-8169-489551751a16 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:09.222243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02c7bd-46ee-407d-8169-489551751a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:09.297205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4b02c7bd-46ee-407d-8169-489551751a16 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:09.298387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4b02c7bd-46ee-407d-8169-489551751a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:09.393807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:09.548190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fda73-7b8b-4e4b-9fc1-ce005130b83e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:09.549619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c92fda73-7b8b-4e4b-9fc1-ce005130b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:09.632486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:09.695653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92fda73-7b8b-4e4b-9fc1-ce005130b83e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:09.806535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:09.807055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:09.807332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:09.807618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:09.809227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:09.856730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:09.906156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:09.907742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a62cae-e8b3-4472-9900-89d833e37e6f service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:09.926626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 718/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:10.717872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9a46-7fa0-468c-9a0c-e0ecc6a0c55d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:10.718412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9a46-7fa0-468c-9a0c-e0ecc6a0c55d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:10.718412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c9a46-7fa0-468c-9a0c-e0ecc6a0c55d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:10.719680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:10.724777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e147-5ace-458f-904a-bddb24ff3f67 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:10.725230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e147-5ace-458f-904a-bddb24ff3f67 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:10.725343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d62e147-5ace-458f-904a-bddb24ff3f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:10.800755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0d62e147-5ace-458f-904a-bddb24ff3f67 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:10.801964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0d62e147-5ace-458f-904a-bddb24ff3f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:10.896934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:11.052738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c9a46-7fa0-468c-9a0c-e0ecc6a0c55d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:11.054171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cc7c9a46-7fa0-468c-9a0c-e0ecc6a0c55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:11.102193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:11.196635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7c9a46-7fa0-468c-9a0c-e0ecc6a0c55d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:11.307796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:11.308456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:11.308740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:11.309010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:11.310616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:11.317481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:11.399395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:11.401069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1c782-8975-4c79-a0ce-e7e29b574815 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:11.423334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 712/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:12.231041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6917b-7e9e-4ebd-a670-26a178823863 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:12.231610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6917b-7e9e-4ebd-a670-26a178823863 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:12.231610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6917b-7e9e-4ebd-a670-26a178823863 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:12.233040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:12.238543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96a58-3ed5-423c-acb3-4df223684d25 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:12.238985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96a58-3ed5-423c-acb3-4df223684d25 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:12.239106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c96a58-3ed5-423c-acb3-4df223684d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:12.331726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e5c96a58-3ed5-423c-acb3-4df223684d25 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:12.332979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e5c96a58-3ed5-423c-acb3-4df223684d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:12.400508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:12.429451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:12.579419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6917b-7e9e-4ebd-a670-26a178823863 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:12.581010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0eb6917b-7e9e-4ebd-a670-26a178823863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:12.599461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:12.736967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6917b-7e9e-4ebd-a670-26a178823863 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:12.825336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:12.851169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:12.851702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:12.852008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:12.852280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:12.853852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:12.940734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:12.942367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2dca9-4b72-479f-aa53-4cdfc6e486c1 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:12.961378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 721/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:13.768574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfdaf1-14a9-41d5-8fcf-95a3049ddab2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:13.769176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfdaf1-14a9-41d5-8fcf-95a3049ddab2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:13.769375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedfdaf1-14a9-41d5-8fcf-95a3049ddab2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:13.771069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:13.776066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab74cf-6b8f-4014-b178-5bd29466b0ff None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:13.776499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab74cf-6b8f-4014-b178-5bd29466b0ff None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:13.776613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab74cf-6b8f-4014-b178-5bd29466b0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:13.851549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-efab74cf-6b8f-4014-b178-5bd29466b0ff None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:13.852788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-efab74cf-6b8f-4014-b178-5bd29466b0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:13.893788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:13.948520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:14.105377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfdaf1-14a9-41d5-8fcf-95a3049ddab2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:14.106797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cedfdaf1-14a9-41d5-8fcf-95a3049ddab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:14.251171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedfdaf1-14a9-41d5-8fcf-95a3049ddab2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:14.304369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:14.361932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:14.363174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:14.363449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:14.363716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:14.365322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:14.452273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:14.453858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289319d8-317c-4a48-840a-07afbc5b2c09 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:14.472587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 715/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:15.269836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fff39-f3ec-4475-8930-743711ec6240 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:15.270367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fff39-f3ec-4475-8930-743711ec6240 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:15.270367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4fff39-f3ec-4475-8930-743711ec6240 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:15.271682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:10:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:15.276595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edb2a3-8eba-4f22-9114-e60068ce8f0c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:15.277012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edb2a3-8eba-4f22-9114-e60068ce8f0c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:15.277128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23edb2a3-8eba-4f22-9114-e60068ce8f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:15.354598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-23edb2a3-8eba-4f22-9114-e60068ce8f0c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:15.355798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-23edb2a3-8eba-4f22-9114-e60068ce8f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:15.357812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:15.453593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:15.604721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fff39-f3ec-4475-8930-743711ec6240 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:15.606254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-df4fff39-f3ec-4475-8930-743711ec6240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:15.747518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4fff39-f3ec-4475-8930-743711ec6240 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:15.773061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:15.860293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:15.860818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:15.861097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:15.861368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:15.862992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:15.952030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:15.953648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafce240-0bb0-4327-8fce-a0f7ff22f822 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:15.972914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 724/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:17.794034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008330-1ef9-4132-966a-874f26dfead2 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:17.794599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008330-1ef9-4132-966a-874f26dfead2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:17.794599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c008330-1ef9-4132-966a-874f26dfead2 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:17.795910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:17.801749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb03a-7c3a-467c-92f7-f3951a7122dd None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:17.802183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb03a-7c3a-467c-92f7-f3951a7122dd None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:17.802290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ecb03a-7c3a-467c-92f7-f3951a7122dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:17.841924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:17.867345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-40ecb03a-7c3a-467c-92f7-f3951a7122dd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:17.868551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-40ecb03a-7c3a-467c-92f7-f3951a7122dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:17.963805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:10:18.251487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c008330-1ef9-4132-966a-874f26dfead2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:18.253643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7c008330-1ef9-4132-966a-874f26dfead2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:18.354291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c008330-1ef9-4132-966a-874f26dfead2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:18.386982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:18.427823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:18.428458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:18.428735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:18.429004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:18.430584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:18.535543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:18.536995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de2e10-2106-440e-b3a0-5ea61d1d2393 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:18.554718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 718/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:20.589549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9d20-e613-46dc-8b4c-0f8932829d81 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:20.590101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9d20-e613-46dc-8b4c-0f8932829d81 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:20.590101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9d20-e613-46dc-8b4c-0f8932829d81 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:20.591441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:20.597208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585d3b4-bdc4-4ee8-8b73-d60eb4774614 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:20.597614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585d3b4-bdc4-4ee8-8b73-d60eb4774614 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:20.597752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585d3b4-bdc4-4ee8-8b73-d60eb4774614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:20.662586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1585d3b4-bdc4-4ee8-8b73-d60eb4774614 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:20.663712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1585d3b4-bdc4-4ee8-8b73-d60eb4774614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:20.676418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:20.758735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:21.042092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9d20-e613-46dc-8b4c-0f8932829d81 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:21.043654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-853a9d20-e613-46dc-8b4c-0f8932829d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:21.145750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9d20-e613-46dc-8b4c-0f8932829d81 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:21.157481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:21.219878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:21.220434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:21.220709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:21.220976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:21.222542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:21.327613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:21.329084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f7fe-a28e-415e-904a-5c90438c05eb service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:21.347238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 727/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:23.531847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73ba9-0892-4bc6-9116-356798970d2d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:23.532452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73ba9-0892-4bc6-9116-356798970d2d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:23.532452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c73ba9-0892-4bc6-9116-356798970d2d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:23.533815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:23.539493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba857b-1f5f-4c04-9ef7-07656840f6b0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:23.539933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba857b-1f5f-4c04-9ef7-07656840f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:23.540082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba857b-1f5f-4c04-9ef7-07656840f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:23.586718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:23.604388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-85ba857b-1f5f-4c04-9ef7-07656840f6b0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:23.605581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-85ba857b-1f5f-4c04-9ef7-07656840f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:23.702594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:23.988451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73ba9-0892-4bc6-9116-356798970d2d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:23.990040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a8c73ba9-0892-4bc6-9116-356798970d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:24.099410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c73ba9-0892-4bc6-9116-356798970d2d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:24.138038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:24.172658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:24.173294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:24.173571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:24.173837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:24.175432 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:24.281541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:24.282885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38bbc6c-5754-4897-8c18-b76bb96e024a service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:24.300972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 721/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:26.390135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537722b-1455-4270-b70f-d15b8f231080 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:26.390591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537722b-1455-4270-b70f-d15b8f231080 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:26.390695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537722b-1455-4270-b70f-d15b8f231080 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:26.392105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:26.397942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da3b5-607e-49f1-a1fb-cd0bc411ba2d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:26.398376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da3b5-607e-49f1-a1fb-cd0bc411ba2d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:26.398495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9da3b5-607e-49f1-a1fb-cd0bc411ba2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:26.463341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3a9da3b5-607e-49f1-a1fb-cd0bc411ba2d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:26.464590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3a9da3b5-607e-49f1-a1fb-cd0bc411ba2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:26.484643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:26.559312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:26.842353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537722b-1455-4270-b70f-d15b8f231080 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:26.843876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e537722b-1455-4270-b70f-d15b8f231080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:26.947090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537722b-1455-4270-b70f-d15b8f231080 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:26.967406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:27.022160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:27.023061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:27.023341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:27.023612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:27.025231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:27.132000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:27.133356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b84044-f978-4764-b3c4-cf9b437927ef service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:27.151444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 730/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:29.084143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171b44-050b-49a8-b7df-352b5508cf3d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:29.084707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171b44-050b-49a8-b7df-352b5508cf3d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:29.084707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05171b44-050b-49a8-b7df-352b5508cf3d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:29.086036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:29.091417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf3f92-d4b2-4830-9dba-ab9d402c4958 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:29.091845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf3f92-d4b2-4830-9dba-ab9d402c4958 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:29.092004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bf3f92-d4b2-4830-9dba-ab9d402c4958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:29.153922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:29.156883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-04bf3f92-d4b2-4830-9dba-ab9d402c4958 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:29.158587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-04bf3f92-d4b2-4830-9dba-ab9d402c4958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:29.253494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:29.548872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05171b44-050b-49a8-b7df-352b5508cf3d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:29.550438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-05171b44-050b-49a8-b7df-352b5508cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:29.654625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05171b44-050b-49a8-b7df-352b5508cf3d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:29.706514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:29.731514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:29.732149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:29.732424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:29.732690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:29.734275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:29.840766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:29.842209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa640a2-3618-4369-8385-082703d6f8ec service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:29.859972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 724/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:31.804376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2dbef-3d75-457d-bca1-d0e2a7f3dfec None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:31.804950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2dbef-3d75-457d-bca1-d0e2a7f3dfec None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:31.804950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a2dbef-3d75-457d-bca1-d0e2a7f3dfec None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:31.806281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:31.811537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3d62-5cd6-4d4d-a0b0-e3ab3d20d4a6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:31.811995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3d62-5cd6-4d4d-a0b0-e3ab3d20d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:31.812113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b3d62-5cd6-4d4d-a0b0-e3ab3d20d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:31.876384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ff8b3d62-5cd6-4d4d-a0b0-e3ab3d20d4a6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:31.877570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ff8b3d62-5cd6-4d4d-a0b0-e3ab3d20d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:31.906283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:31.976811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:32.260570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2dbef-3d75-457d-bca1-d0e2a7f3dfec None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:32.262110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-57a2dbef-3d75-457d-bca1-d0e2a7f3dfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:32.363681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a2dbef-3d75-457d-bca1-d0e2a7f3dfec None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:32.391968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:32.437185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:32.437702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:32.437977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:32.438243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:32.439801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:32.546636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:32.548111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc2ea7-deca-4abd-9f9c-f1a0ad17557f service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:32.571673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 733/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:34.515931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799f97-61ff-43f1-81cd-9a6177ce764e None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:34.516494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799f97-61ff-43f1-81cd-9a6177ce764e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:34.516592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a799f97-61ff-43f1-81cd-9a6177ce764e None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:34.517944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:34.523675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e433fa-6e41-4b51-94b4-20208e580bee None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:34.524111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e433fa-6e41-4b51-94b4-20208e580bee None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:34.524254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e433fa-6e41-4b51-94b4-20208e580bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:34.589373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-90e433fa-6e41-4b51-94b4-20208e580bee None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:34.590619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-90e433fa-6e41-4b51-94b4-20208e580bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:34.598813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:34.686482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:34.973534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799f97-61ff-43f1-81cd-9a6177ce764e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:34.975066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7a799f97-61ff-43f1-81cd-9a6177ce764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:35.095537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a799f97-61ff-43f1-81cd-9a6177ce764e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:35.153926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:35.175277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:35.176027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:35.176371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:35.176605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:35.178546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:35.405869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:35.407296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2734adb9-b858-46e6-bac0-28902d4c2461 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:35.426049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 727/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:37.379555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5de1-6731-4aad-8924-48d6dcabb9a4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:37.380319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5de1-6731-4aad-8924-48d6dcabb9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:37.380319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633a5de1-6731-4aad-8924-48d6dcabb9a4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:37.381558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:10:37.387040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192daa-79d9-47c9-90f4-3dc42521a343 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:37.387455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192daa-79d9-47c9-90f4-3dc42521a343 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:37.387585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf192daa-79d9-47c9-90f4-3dc42521a343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:37.451458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cf192daa-79d9-47c9-90f4-3dc42521a343 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:37.452682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cf192daa-79d9-47c9-90f4-3dc42521a343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:37.489590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:37.546611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:10:37.837067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5de1-6731-4aad-8924-48d6dcabb9a4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:37.838648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-633a5de1-6731-4aad-8924-48d6dcabb9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:37.941999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633a5de1-6731-4aad-8924-48d6dcabb9a4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:37.979585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:38.016950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:38.017554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:38.017832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:38.018102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:38.019720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:38.127582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:38.129007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef43e94-44bb-4fb3-bbd3-4a8cd043ff7b service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:38.148629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 736/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:40.086981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6d59-9d8b-485b-96ab-bdf5d7decfc4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:40.087527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6d59-9d8b-485b-96ab-bdf5d7decfc4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:40.087527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd6d59-9d8b-485b-96ab-bdf5d7decfc4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:40.088902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:40.094238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ec2c9-8ba0-489c-b278-ef415e099a56 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:40.094653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ec2c9-8ba0-489c-b278-ef415e099a56 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:40.094769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ec2c9-8ba0-489c-b278-ef415e099a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:40.163262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-980ec2c9-8ba0-489c-b278-ef415e099a56 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:40.164502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-980ec2c9-8ba0-489c-b278-ef415e099a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:40.182377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:40.261241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:10:40.543067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6d59-9d8b-485b-96ab-bdf5d7decfc4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:40.544630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e1cd6d59-9d8b-485b-96ab-bdf5d7decfc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:40.647833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd6d59-9d8b-485b-96ab-bdf5d7decfc4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:40.712629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:40.726204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:40.726851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:40.727130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:40.727394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:40.729043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:40.836319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:40.837752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205ca19f-ecdb-4c27-a7da-b952aed9af0c service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:40.857450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 730/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:42.775526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c92c10-28d9-4b93-8f90-4cf3fa654572 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:42.776104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c92c10-28d9-4b93-8f90-4cf3fa654572 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:42.776104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c92c10-28d9-4b93-8f90-4cf3fa654572 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:42.777397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:10:42.782566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb826d-e22f-44d8-ae75-c139d3afcede None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:42.782971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb826d-e22f-44d8-ae75-c139d3afcede None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:42.783080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb826d-e22f-44d8-ae75-c139d3afcede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:42.850830 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-aafb826d-e22f-44d8-ae75-c139d3afcede None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:10:42.852057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-aafb826d-e22f-44d8-ae75-c139d3afcede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:42.899200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:42.947185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:10:43.227890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c92c10-28d9-4b93-8f90-4cf3fa654572 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:10:43.229426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-28c92c10-28d9-4b93-8f90-4cf3fa654572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:43.331265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c92c10-28d9-4b93-8f90-4cf3fa654572 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:10:43.377480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:43.404291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:10:43.404864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:10:43.405145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:10:43.405411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:10:43.406995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:10:43.522555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:10:43.523941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e503e9e-2ba9-40b1-ba5a-766b9a080f1f service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:10:43.542210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 739/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:10:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:10:52.945172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=22 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:10:53.539808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=66 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:03.132643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818e85-4a32-43d2-afc1-c9cfa2723d17 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:03.133179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818e85-4a32-43d2-afc1-c9cfa2723d17 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:03.133179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35818e85-4a32-43d2-afc1-c9cfa2723d17 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:03.134759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 732/1471] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:03.139731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07628a0c-620c-4516-827a-5b44d7696e94 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:03.140167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07628a0c-620c-4516-827a-5b44d7696e94 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:03.140320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07628a0c-620c-4516-827a-5b44d7696e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:03.206365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-07628a0c-620c-4516-827a-5b44d7696e94 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:03.207548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-07628a0c-620c-4516-827a-5b44d7696e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:03.300830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 740/1472] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:03.628214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f28f7-7e47-4af3-bab4-0e24684f832b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:03.628507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f28f7-7e47-4af3-bab4-0e24684f832b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:03.628783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56f28f7-7e47-4af3-bab4-0e24684f832b None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:03.630172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 733/1473] 10.222.0.48 () {54 vars in 967 bytes} [Wed Aug 31 12:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:03.634994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2daf65-1c8f-415d-a7a3-3e6888016e0e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:03.635277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2daf65-1c8f-415d-a7a3-3e6888016e0e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:03.635548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2daf65-1c8f-415d-a7a3-3e6888016e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:03.709508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2b2daf65-1c8f-415d-a7a3-3e6888016e0e None None] MFA Rules not processed for user `8f9c000fb6194cbe8fe70841753c079c`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:03.711193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2b2daf65-1c8f-415d-a7a3-3e6888016e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:03.731117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:03.786394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 741/1474] 10.222.0.48 () {58 vars in 1064 bytes} [Wed Aug 31 12:11:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:03.794215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f28f7-7e47-4af3-bab4-0e24684f832b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:03.796057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f56f28f7-7e47-4af3-bab4-0e24684f832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:03.897541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56f28f7-7e47-4af3-bab4-0e24684f832b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:03.970138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:03.970740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:03.971014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:03.971778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:03.973383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:04.025655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:04.079119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:04.080570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8138cb8-b1dc-4c93-8444-7e2b8a9afda8 service glance] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:04.099306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 734/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:11:06.081919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7d4fd-c64c-4635-acf9-b6cf542817a7 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:06.082460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7d4fd-c64c-4635-acf9-b6cf542817a7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:06.082460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7d4fd-c64c-4635-acf9-b6cf542817a7 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:06.083798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 742/1476] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:06.089174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b564-e611-45d1-8346-2677efffa077 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:06.089634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b564-e611-45d1-8346-2677efffa077 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:06.089749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b564-e611-45d1-8346-2677efffa077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:06.155145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6bf5b564-e611-45d1-8346-2677efffa077 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:06.156379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6bf5b564-e611-45d1-8346-2677efffa077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:06.253740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 735/1477] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:06.524446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7d4fd-c64c-4635-acf9-b6cf542817a7 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:06.525905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7af7d4fd-c64c-4635-acf9-b6cf542817a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:06.647798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7d4fd-c64c-4635-acf9-b6cf542817a7 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:06.695297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:06.740784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:06.741382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:06.741658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:06.741923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:06.742552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:06.744307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:11:06.744307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:11:06.744307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:11:06.745440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea60d2-f3be-4c60-b648-8a3170997271 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:06.763466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 743/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Aug 31 12:11:06 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:11:08.684835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf63cc5-aec2-4564-be02-c70c966b8b89 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:08.685359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf63cc5-aec2-4564-be02-c70c966b8b89 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:08.685359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf63cc5-aec2-4564-be02-c70c966b8b89 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:08.686697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 736/1479] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:08.692456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa7a4b-2c19-41be-900c-320bbdb0dd33 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:08.692873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa7a4b-2c19-41be-900c-320bbdb0dd33 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:08.692999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa7a4b-2c19-41be-900c-320bbdb0dd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:08.757681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-22fa7a4b-2c19-41be-900c-320bbdb0dd33 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:08.758882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-22fa7a4b-2c19-41be-900c-320bbdb0dd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:08.853918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 744/1480] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:09.145614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf63cc5-aec2-4564-be02-c70c966b8b89 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:09.147127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-edf63cc5-aec2-4564-be02-c70c966b8b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:09.157333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:09.289598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf63cc5-aec2-4564-be02-c70c966b8b89 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:09.366488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:09.398862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:09.399463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:09.399734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:09.400034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:09.401597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:09.493547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:09.495133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee4892-364a-49eb-8c09-a7b4da20f7ab service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:09.512583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 737/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:11:11.622295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee5b54-fde4-40f3-b665-db5c085dd242 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:11.622895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee5b54-fde4-40f3-b665-db5c085dd242 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:11.622895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee5b54-fde4-40f3-b665-db5c085dd242 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:11.624211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 745/1482] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:11.629504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9def8-f3e3-4044-8565-4edcd2873ff5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:11.629914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9def8-f3e3-4044-8565-4edcd2873ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:11.630055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9def8-f3e3-4044-8565-4edcd2873ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:11.696396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-10c9def8-f3e3-4044-8565-4edcd2873ff5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:11.697609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-10c9def8-f3e3-4044-8565-4edcd2873ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:11.743045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:11.794394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 738/1483] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:12.085877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee5b54-fde4-40f3-b665-db5c085dd242 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:12.087414 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1dee5b54-fde4-40f3-b665-db5c085dd242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:12.110059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:12.194400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee5b54-fde4-40f3-b665-db5c085dd242 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:12.286088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:12.286603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:12.286879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:12.287149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:12.288751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:12.359653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:12.395476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:12.396977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c077b462-ceb2-4e06-8dab-a7ab9cf91954 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:12.416755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 746/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:11:14.379623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52ea47-073a-4dd5-a285-86655b8870dd None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:14.380234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52ea47-073a-4dd5-a285-86655b8870dd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:14.380234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52ea47-073a-4dd5-a285-86655b8870dd None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:14.381543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 739/1485] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:14.386594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b68d-a8fa-4b7b-a860-ec1b54969f3c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:14.387003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b68d-a8fa-4b7b-a860-ec1b54969f3c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:14.387136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc7b68d-a8fa-4b7b-a860-ec1b54969f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:14.451189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4fc7b68d-a8fa-4b7b-a860-ec1b54969f3c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:14.452403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4fc7b68d-a8fa-4b7b-a860-ec1b54969f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:14.548997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 747/1486] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:14.833985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52ea47-073a-4dd5-a285-86655b8870dd None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:14.835502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ba52ea47-073a-4dd5-a285-86655b8870dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:14.937470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52ea47-073a-4dd5-a285-86655b8870dd None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:15.015160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:15.017029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:15.017703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:15.018020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:15.018856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:15.021060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:15.128761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:15.130169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25639be8-a280-4d57-a58f-5bfa2c69a3dd service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:15.148156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 740/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:11:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:11:17.253762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9d27-600c-4fd5-8442-f7b8800c618c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:17.254329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9d27-600c-4fd5-8442-f7b8800c618c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:17.254329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066c9d27-600c-4fd5-8442-f7b8800c618c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:17.255579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 748/1488] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:17.260810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc5542-997d-4957-bee0-28e67e571d1b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:17.261936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc5542-997d-4957-bee0-28e67e571d1b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:17.261936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc5542-997d-4957-bee0-28e67e571d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:17.325724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-bbcc5542-997d-4957-bee0-28e67e571d1b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:17.326944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bbcc5542-997d-4957-bee0-28e67e571d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:17.378856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:17.422995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 741/1489] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:17.723175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9d27-600c-4fd5-8442-f7b8800c618c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:17.724733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-066c9d27-600c-4fd5-8442-f7b8800c618c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:17.759780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:17.826757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066c9d27-600c-4fd5-8442-f7b8800c618c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:17.898661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:17.899260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:17.899546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:17.899834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:17.901438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:17.981434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:18.010407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:18.011864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c1510-afb0-461b-acd7-4b83023edd45 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:18.030749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 749/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:11:20.166293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68988a6d-72ac-4506-b9b3-f441b925bda4 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:20.166862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68988a6d-72ac-4506-b9b3-f441b925bda4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:20.166862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68988a6d-72ac-4506-b9b3-f441b925bda4 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:20.168327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 742/1491] 10.222.0.48 () {54 vars in 927 bytes} [Wed Aug 31 12:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:11:20.175704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc8b2-bd9f-494a-b6f7-8c51dd71aaf0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:20.176159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc8b2-bd9f-494a-b6f7-8c51dd71aaf0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:20.176280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cc8b2-bd9f-494a-b6f7-8c51dd71aaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:20.241943 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c99cc8b2-bd9f-494a-b6f7-8c51dd71aaf0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:11:20.243069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c99cc8b2-bd9f-494a-b6f7-8c51dd71aaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:20.336371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 750/1492] 10.222.0.48 () {58 vars in 1024 bytes} [Wed Aug 31 12:11:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:11:20.639757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68988a6d-72ac-4506-b9b3-f441b925bda4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:11:20.641353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-68988a6d-72ac-4506-b9b3-f441b925bda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:20.743426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68988a6d-72ac-4506-b9b3-f441b925bda4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:11:20.814160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:11:20.814761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:11:20.815038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:11:20.815307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:11:20.816915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:11:20.826125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:20.925411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:11:20.926936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99bf0b-fe5b-4c03-9796-663b96f021c1 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:11:20.945141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 743/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:11:30.334580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=82 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:11:30.942849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=50 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:41.087321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:41.087878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:41.087878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:41.162183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:12:41.163382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:41.259520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 751/1494] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:12:41.267699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:41.268226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:41.268323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:41.342433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:12:41.343641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:41.449489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 744/1495] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:12:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:12:41.453592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:41.455339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:41.466935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfae12e-1519-4481-817f-649783bc7580 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:41.529465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:41.563030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:41.563631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:41.564458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:41.564729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:41.565371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:12:41.565673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:41.566691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:41.566691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:12:41.566691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:12:41.567578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:41.578762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 752/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:12:41.587635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:41.596773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b5c8f-f6cd-4da9-9bbb-5bdff36aac7f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:41.657141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:41.691227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:41.691823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:41.692129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:41.692399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:41.693033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:41.694761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:41.694761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:12:41.694761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:12:41.695967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:41.750044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 745/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:12:41 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:12:41.754810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:41.756405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:41.791275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da749a5a-73eb-448e-bd3c-be57f3e44ea1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:41.884781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:41.885380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:41.885654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:41.885921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:41.886549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:41.887558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:41.887558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:12:41.887558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:12:41.888788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:41.929807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 753/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:12:41 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:12:41.933889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:41.935397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:41.997054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7339f9a-6098-407c-bcd3-846fad284c3b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:42.080479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:42.091899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:42.092540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.092820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.093088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.093721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:42.094736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:42.094736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:12:42.094736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:12:42.096244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:42.108788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 746/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:12:42.113381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:42.114900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:42.126321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e8837b-f147-4861-8405-2b19f7420648 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:42.151148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:42.219818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:42.220951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.221228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.221496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.222129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:42.223135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:42.223135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:12:42.223135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:12:42.224036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3a493-8f81-4958-9b80-32313cc4cb7e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:42.236563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 754/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:12:42.240765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:42.242398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:42.274360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e16e5-1297-4539-9588-d0c0098d6383 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:42.367273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:42.367853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.368161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.368434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] PATH_INFO: `/v3/projects/6f59c4f9bec84a2e9d780e43b64e2293/users/b45b9bf6215b4a4a9323ba2dd7e95582/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.389786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f59c4f9bec84a2e9d780e43b64e2293, user_id=b45b9bf6215b4a4a9323ba2dd7e95582, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:42.390815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:42.390815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:12:42.390815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:12:42.393353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e2ff-a1b4-477d-b569-4fcf81306c8e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:42.417536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 747/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:12:42 2022] PUT /identity/v3/projects/6f59c4f9bec84a2e9d780e43b64e2293/users/b45b9bf6215b4a4a9323ba2dd7e95582/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:12:42.429653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f97205-a924-422b-9239-bb20ed560f76 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.429936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f97205-a924-422b-9239-bb20ed560f76 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.430236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f97205-a924-422b-9239-bb20ed560f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.487656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-43f97205-a924-422b-9239-bb20ed560f76 None None] MFA Rules not processed for user `b45b9bf6215b4a4a9323ba2dd7e95582`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:12:42.488898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-43f97205-a924-422b-9239-bb20ed560f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:42.564943 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 755/1502] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:12:42.578109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ea06-b5be-4487-b867-f40935902a8a None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.578402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ea06-b5be-4487-b867-f40935902a8a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.578677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570ea06-b5be-4487-b867-f40935902a8a None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.580589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 748/1503] 10.222.0.48 () {54 vars in 964 bytes} [Wed Aug 31 12:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:12:42.585283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892894d3-7f62-4216-9da7-2de30fb3671e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.585564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892894d3-7f62-4216-9da7-2de30fb3671e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.585838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892894d3-7f62-4216-9da7-2de30fb3671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.616125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:42.661785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-892894d3-7f62-4216-9da7-2de30fb3671e None None] MFA Rules not processed for user `5995bbc9449c472ca4f15fc9dddb2092`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:12:42.662911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-892894d3-7f62-4216-9da7-2de30fb3671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:42.736168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 756/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Aug 31 12:12:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:12:42.746012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ea06-b5be-4487-b867-f40935902a8a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:42.747548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a570ea06-b5be-4487-b867-f40935902a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:42.797166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:42.853901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570ea06-b5be-4487-b867-f40935902a8a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:42.925315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:42.925852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:42.926125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:42.926393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:42.927999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:43.028282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:43.029724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:43.033196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:43.047906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 749/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:12:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:43.092623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dd33a-5ef1-4874-9cd8-8ded72ea7c6a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:43.092908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dd33a-5ef1-4874-9cd8-8ded72ea7c6a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:43.093177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2dd33a-5ef1-4874-9cd8-8ded72ea7c6a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:43.094456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 757/1506] 10.222.0.48 () {52 vars in 830 bytes} [Wed Aug 31 12:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:12:43.097972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:43.099226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:43.198300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffcdddb-e484-4797-8381-5bab68cccc8b service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:43.287303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:43.287932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:43.288238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:43.288506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] PATH_INFO: `/v3/users/b45b9bf6215b4a4a9323ba2dd7e95582` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:43.300633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45b9bf6215b4a4a9323ba2dd7e95582)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:43.301625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:43.301625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:12:43.301625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:12:43.302828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:43.312060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:43.365638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45b9bf6215b4a4a9323ba2dd7e95582'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:43.374708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45b9bf6215b4a4a9323ba2dd7e95582'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:43.375204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45b9bf6215b4a4a9323ba2dd7e95582'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:43.399880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45b9bf6215b4a4a9323ba2dd7e95582'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:43.400361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45b9bf6215b4a4a9323ba2dd7e95582'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:43.418794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 750/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:12:43 2022] DELETE /identity/v3/users/b45b9bf6215b4a4a9323ba2dd7e95582 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:12:43.423734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:43.424257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:43.424373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:43.487502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:12:43.488643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:43.561483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:43.574554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 758/1508] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:12:43.584285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:43.585544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:43.684133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6371b3-b7e4-45f4-b14e-5c3c162f23ba admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:43.737287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:43.756854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:43.757403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:43.757677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:43.757946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:43.759512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:43.871505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:43.873767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e949aca-0320-4ea1-849e-32374c7fd232 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:43.899761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 751/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:12:44.241481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:12:44.242779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:12:44.256136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221dcda9-0999-46d7-8086-f37ec545d74d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:12:44.360490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:12:44.361131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:12:44.361397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:12:44.361668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] PATH_INFO: `/v3/projects/6f59c4f9bec84a2e9d780e43b64e2293` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:12:44.371216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f59c4f9bec84a2e9d780e43b64e2293)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:12:44.372275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:12:44.372275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:12:44.372275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:12:44.373475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:12:44.430518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f59c4f9bec84a2e9d780e43b64e2293', 'request_id': 'req-225e33e1-424a-45a7-846d-d8c50028c0f7'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:44.444684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f59c4f9bec84a2e9d780e43b64e2293', 'request_id': 'req-225e33e1-424a-45a7-846d-d8c50028c0f7'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:44.455279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f59c4f9bec84a2e9d780e43b64e2293', 'request_id': 'req-225e33e1-424a-45a7-846d-d8c50028c0f7'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:44.477589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] The token cache is being invalidate because project 6f59c4f9bec84a2e9d780e43b64e2293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:12:44.477880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:44.478611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-225e33e1-424a-45a7-846d-d8c50028c0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:12:44.480033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 759/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:12:44 2022] DELETE /identity/v3/projects/6f59c4f9bec84a2e9d780e43b64e2293 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:12:53.897463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=62 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:12:54.475570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:22.904607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772462c-e8f2-4b3d-8b34-9a23c407bb38 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:22.905188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772462c-e8f2-4b3d-8b34-9a23c407bb38 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:22.905188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772462c-e8f2-4b3d-8b34-9a23c407bb38 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:22.906529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:22.911524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add067a8-ce06-4bf1-9d95-bd527bcd9f9c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:22.911979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add067a8-ce06-4bf1-9d95-bd527bcd9f9c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:22.912127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add067a8-ce06-4bf1-9d95-bd527bcd9f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:22.994252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-add067a8-ce06-4bf1-9d95-bd527bcd9f9c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:22.995447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-add067a8-ce06-4bf1-9d95-bd527bcd9f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:23.099905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:23.253114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772462c-e8f2-4b3d-8b34-9a23c407bb38 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:23.255244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f772462c-e8f2-4b3d-8b34-9a23c407bb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:23.371529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772462c-e8f2-4b3d-8b34-9a23c407bb38 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:23.377438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0eca9-8793-4f63-a195-572500bdb54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:23.378038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0eca9-8793-4f63-a195-572500bdb54a service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:23.378316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0eca9-8793-4f63-a195-572500bdb54a service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:23.378586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0eca9-8793-4f63-a195-572500bdb54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:23.386478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0eca9-8793-4f63-a195-572500bdb54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:23.388084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0eca9-8793-4f63-a195-572500bdb54a service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:23.397884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 753/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:24.231567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82371479-fca9-4398-84db-fdcbcfc55ec5 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:24.231567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82371479-fca9-4398-84db-fdcbcfc55ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:24.231567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82371479-fca9-4398-84db-fdcbcfc55ec5 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:24.231567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:24.232381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05851cb-e9a5-41e8-9055-9cc3894573be None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:24.232381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05851cb-e9a5-41e8-9055-9cc3894573be None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:24.232381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05851cb-e9a5-41e8-9055-9cc3894573be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:24.252207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c05851cb-e9a5-41e8-9055-9cc3894573be None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:24.253443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c05851cb-e9a5-41e8-9055-9cc3894573be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:24.262300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:24.415814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82371479-fca9-4398-84db-fdcbcfc55ec5 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:24.431139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82371479-fca9-4398-84db-fdcbcfc55ec5 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:24.436496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e566b9-1cfc-4bea-b7d3-9a904474655d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:24.437659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e566b9-1cfc-4bea-b7d3-9a904474655d service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:24.437937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e566b9-1cfc-4bea-b7d3-9a904474655d service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:24.438203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e566b9-1cfc-4bea-b7d3-9a904474655d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:24.446534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e566b9-1cfc-4bea-b7d3-9a904474655d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:24.448151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e566b9-1cfc-4bea-b7d3-9a904474655d service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:24.457888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 762/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:24.957936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5cfc-174e-443d-86ff-197d9982e26b None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:24.958219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5cfc-174e-443d-86ff-197d9982e26b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:24.958491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc5cfc-174e-443d-86ff-197d9982e26b None None] PATH_INFO: `/v3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:24.959781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 755/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Aug 31 12:14:24 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:14:24.966005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a393a-8224-47f8-9e6b-ed0eb848713c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:24.966290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a393a-8224-47f8-9e6b-ed0eb848713c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:24.966562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a393a-8224-47f8-9e6b-ed0eb848713c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:25.024702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9d7a393a-8224-47f8-9e6b-ed0eb848713c None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:25.025901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9d7a393a-8224-47f8-9e6b-ed0eb848713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:25.042672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:25.097083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 763/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 31 12:14:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:34.246081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=56 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:34.478335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fbef-663a-411e-8ed0-730a1d9dd900 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:34.478604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fbef-663a-411e-8ed0-730a1d9dd900 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:34.478876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795fbef-663a-411e-8ed0-730a1d9dd900 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:34.480266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 756/1519] 10.222.0.48 () {54 vars in 961 bytes} [Wed Aug 31 12:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:34.485793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1558b-b736-447d-b641-017ca15c492f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:34.486248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1558b-b736-447d-b641-017ca15c492f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:34.486399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1558b-b736-447d-b641-017ca15c492f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:34.506453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-83a1558b-b736-447d-b641-017ca15c492f None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:34.507627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-83a1558b-b736-447d-b641-017ca15c492f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:34.515985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 764/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Aug 31 12:14:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:14:34.523382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795fbef-663a-411e-8ed0-730a1d9dd900 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:34.537311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795fbef-663a-411e-8ed0-730a1d9dd900 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:34.542221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9087ba-839c-4b2a-8fa2-2ada2d12aa4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:34.542810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9087ba-839c-4b2a-8fa2-2ada2d12aa4e service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:34.543086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9087ba-839c-4b2a-8fa2-2ada2d12aa4e service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:34.543356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9087ba-839c-4b2a-8fa2-2ada2d12aa4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:34.552072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9087ba-839c-4b2a-8fa2-2ada2d12aa4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:34.553636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9087ba-839c-4b2a-8fa2-2ada2d12aa4e service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:34.562985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 757/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:35.658584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6577d-7e5a-403a-998b-1b1cd4ba2f9a None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:35.659176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6577d-7e5a-403a-998b-1b1cd4ba2f9a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:35.659176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd6577d-7e5a-403a-998b-1b1cd4ba2f9a None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:35.660531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:35.665313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76def-d402-46e0-a015-3be371b9bc25 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:35.665715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76def-d402-46e0-a015-3be371b9bc25 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:35.665857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d76def-d402-46e0-a015-3be371b9bc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:35.685472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a2d76def-d402-46e0-a015-3be371b9bc25 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:35.687275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a2d76def-d402-46e0-a015-3be371b9bc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:35.695151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:35.849194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6577d-7e5a-403a-998b-1b1cd4ba2f9a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:35.863863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd6577d-7e5a-403a-998b-1b1cd4ba2f9a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:35.869162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ef832-34d5-4836-85f2-80d660e07e42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:35.869751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ef832-34d5-4836-85f2-80d660e07e42 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:35.870027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ef832-34d5-4836-85f2-80d660e07e42 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:35.870295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ef832-34d5-4836-85f2-80d660e07e42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:35.878995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ef832-34d5-4836-85f2-80d660e07e42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:35.880622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ef832-34d5-4836-85f2-80d660e07e42 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:35.889880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 766/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:36.700940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02a2e-e768-4cb8-bdfd-16c4fc5aef83 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:36.701491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02a2e-e768-4cb8-bdfd-16c4fc5aef83 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:36.701491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e02a2e-e768-4cb8-bdfd-16c4fc5aef83 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:36.703344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 31 12:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:36.707978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046c6c0-d473-4c2b-9478-d0174f483e7e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:36.708432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046c6c0-d473-4c2b-9478-d0174f483e7e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:36.708544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046c6c0-d473-4c2b-9478-d0174f483e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:36.729189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1046c6c0-d473-4c2b-9478-d0174f483e7e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:36.731233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1046c6c0-d473-4c2b-9478-d0174f483e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:36.743561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 31 12:14:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:36.893209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e02a2e-e768-4cb8-bdfd-16c4fc5aef83 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:36.907764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e02a2e-e768-4cb8-bdfd-16c4fc5aef83 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:36.913145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883ddbc-11a1-4f68-8aff-56cd2eb11371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:36.913730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ddbc-11a1-4f68-8aff-56cd2eb11371 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:36.914006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ddbc-11a1-4f68-8aff-56cd2eb11371 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:36.914274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883ddbc-11a1-4f68-8aff-56cd2eb11371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:36.923001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883ddbc-11a1-4f68-8aff-56cd2eb11371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:36.924607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883ddbc-11a1-4f68-8aff-56cd2eb11371 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:36.933899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 760/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:41.088836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83f74-9084-48f4-a83a-50262f692107 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:41.089389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83f74-9084-48f4-a83a-50262f692107 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:41.089389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c83f74-9084-48f4-a83a-50262f692107 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:41.090739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:41.095793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b949403-24fe-4a95-ada1-7ae635f88fa2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:41.096231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b949403-24fe-4a95-ada1-7ae635f88fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:41.096377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b949403-24fe-4a95-ada1-7ae635f88fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:41.115736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1b949403-24fe-4a95-ada1-7ae635f88fa2 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:41.116963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1b949403-24fe-4a95-ada1-7ae635f88fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:41.125327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:41.413648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83f74-9084-48f4-a83a-50262f692107 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:41.415339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f7c83f74-9084-48f4-a83a-50262f692107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:41.494881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c83f74-9084-48f4-a83a-50262f692107 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:41.498438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef7c07-2ae5-454d-ada8-b84e3e83eaa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:41.499073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef7c07-2ae5-454d-ada8-b84e3e83eaa8 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:41.499353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef7c07-2ae5-454d-ada8-b84e3e83eaa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:41.499651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef7c07-2ae5-454d-ada8-b84e3e83eaa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:41.508475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef7c07-2ae5-454d-ada8-b84e3e83eaa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:41.509920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef7c07-2ae5-454d-ada8-b84e3e83eaa8 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:41.519194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 769/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:43.410161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058bed2-debb-4932-9c09-b0812cc1e0fd None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:43.410725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058bed2-debb-4932-9c09-b0812cc1e0fd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:43.410725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058bed2-debb-4932-9c09-b0812cc1e0fd None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:43.412084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:43.417410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f164ad-3d35-4886-ba11-903067014fad None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:43.417826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f164ad-3d35-4886-ba11-903067014fad None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:43.417986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f164ad-3d35-4886-ba11-903067014fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:43.438914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a2f164ad-3d35-4886-ba11-903067014fad None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:43.440267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a2f164ad-3d35-4886-ba11-903067014fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:43.447894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:43.735123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058bed2-debb-4932-9c09-b0812cc1e0fd None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:43.745909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058bed2-debb-4932-9c09-b0812cc1e0fd None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:43.749684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0e3fe-2e89-4dd2-9761-7ebb139db572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:43.750275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0e3fe-2e89-4dd2-9761-7ebb139db572 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:43.750553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0e3fe-2e89-4dd2-9761-7ebb139db572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:43.750826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0e3fe-2e89-4dd2-9761-7ebb139db572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:43.759565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0e3fe-2e89-4dd2-9761-7ebb139db572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:43.761019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0e3fe-2e89-4dd2-9761-7ebb139db572 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:43.770387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 763/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:47.351273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab6b0-a656-46ee-b6a8-584ad7029580 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:47.351873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab6b0-a656-46ee-b6a8-584ad7029580 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:47.351873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ab6b0-a656-46ee-b6a8-584ad7029580 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:47.353194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:47.358966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a14cc-093e-460d-a602-6f1de007c495 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:47.359421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a14cc-093e-460d-a602-6f1de007c495 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:47.359546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a14cc-093e-460d-a602-6f1de007c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:47.378922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-154a14cc-093e-460d-a602-6f1de007c495 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:47.380137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-154a14cc-093e-460d-a602-6f1de007c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:47.387736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:14:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:47.947450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab6b0-a656-46ee-b6a8-584ad7029580 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:47.949422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-623ab6b0-a656-46ee-b6a8-584ad7029580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:48.013057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:14:48.026483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ab6b0-a656-46ee-b6a8-584ad7029580 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:48.030558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec30c8-3f6e-49ea-8a54-b37f8326600a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:48.031157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec30c8-3f6e-49ea-8a54-b37f8326600a service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:48.031437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec30c8-3f6e-49ea-8a54-b37f8326600a service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:48.031703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec30c8-3f6e-49ea-8a54-b37f8326600a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:48.040370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec30c8-3f6e-49ea-8a54-b37f8326600a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:48.041820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec30c8-3f6e-49ea-8a54-b37f8326600a service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:48.051489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 772/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:14:50.010827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfd61e-56ed-4ee7-b389-8d9360e8e6f3 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.011371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfd61e-56ed-4ee7-b389-8d9360e8e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.011371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfd61e-56ed-4ee7-b389-8d9360e8e6f3 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.012786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 31 12:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:14:50.018397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f800-1b18-40ba-8333-ddb1a2a7b7e9 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.018812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f800-1b18-40ba-8333-ddb1a2a7b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.018966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778f800-1b18-40ba-8333-ddb1a2a7b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.038568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b778f800-1b18-40ba-8333-ddb1a2a7b7e9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:14:50.039752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b778f800-1b18-40ba-8333-ddb1a2a7b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:50.048069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 31 12:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:14:50.609640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfd61e-56ed-4ee7-b389-8d9360e8e6f3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:14:50.611375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-37cfd61e-56ed-4ee7-b389-8d9360e8e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:14:50.624307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfd61e-56ed-4ee7-b389-8d9360e8e6f3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:14:50.627812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f46c2-fe92-4d83-bc6a-9bc01d062fbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:14:50.628431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f46c2-fe92-4d83-bc6a-9bc01d062fbb service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:14:50.628710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f46c2-fe92-4d83-bc6a-9bc01d062fbb service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:14:50.628979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f46c2-fe92-4d83-bc6a-9bc01d062fbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:14:50.637616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f46c2-fe92-4d83-bc6a-9bc01d062fbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:14:50.639030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f46c2-fe92-4d83-bc6a-9bc01d062fbb service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:14:50.648694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 766/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:15:00.033479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=11 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:15:00.644681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=33 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:25.275284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6962bc4-46ba-4ccb-9afe-b57ceed6dd32 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.275986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6962bc4-46ba-4ccb-9afe-b57ceed6dd32 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.275986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6962bc4-46ba-4ccb-9afe-b57ceed6dd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.279860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77637eff-9be9-4701-a057-619a5f0fa29d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.280491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77637eff-9be9-4701-a057-619a5f0fa29d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.280491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77637eff-9be9-4701-a057-619a5f0fa29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.303542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-77637eff-9be9-4701-a057-619a5f0fa29d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.305371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-77637eff-9be9-4701-a057-619a5f0fa29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.307841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b6962bc4-46ba-4ccb-9afe-b57ceed6dd32 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.309566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b6962bc4-46ba-4ccb-9afe-b57ceed6dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.315916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 767/1540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:16:25.325085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 774/1541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.326720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.327279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.327805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.335274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.335637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.335819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.358147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.359395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.364413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.365909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.377588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 768/1542] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:16:25.379090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 775/1543] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:16:25.383324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.386168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.406665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb97272-68f3-48d9-846c-794e0bc5f018 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.407935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02269b-5a4a-4bba-a295-865a0ad6ace3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.416841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.417483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.417760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.418554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.419257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:25.419557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.421237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.423564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.424411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.424687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.424957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.425608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:25.425910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.427072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:16:25.427072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:16:25.427072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:16:25.427973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.452796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 776/1544] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:25.455166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 769/1545] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:25.461846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.465306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.489195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ac7b3-0196-4955-a257-3be7c43f8bfb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.492194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a53c9e-2a07-4e10-9dc2-55479dee06a5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.499736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104db48-40ce-4827-ba9c-99148e8e0234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.505872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104db48-40ce-4827-ba9c-99148e8e0234 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.506155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104db48-40ce-4827-ba9c-99148e8e0234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.506431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104db48-40ce-4827-ba9c-99148e8e0234 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.507082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104db48-40ce-4827-ba9c-99148e8e0234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.509024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a104db48-40ce-4827-ba9c-99148e8e0234 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.512624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.513239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.513516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.513787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.514557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.520889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:16:25.520889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:16:25.520889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:16:25.522096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.610898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 770/1546] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:25.611482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 777/1547] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:25.612484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.612764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.613034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.616151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.646578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.647799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.722156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7db21-64e9-47e5-bfcc-6542d96b268b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.727557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76cd146-598e-4b04-b458-4e4e8d0fef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.728542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cd146-598e-4b04-b458-4e4e8d0fef59 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.729014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cd146-598e-4b04-b458-4e4e8d0fef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.729579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76cd146-598e-4b04-b458-4e4e8d0fef59 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.730441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cd146-598e-4b04-b458-4e4e8d0fef59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.733634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76cd146-598e-4b04-b458-4e4e8d0fef59 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.751216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 771/1548] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.754104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.765859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb17f2-01e2-4c3d-8351-a43c6327ab37 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.768823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 778/1549] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/users => generated 284 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:25.772554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.772554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.772991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.773275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.773969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32dd5c-39ee-429b-b93e-88e1e514fafe None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.774124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.774269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32dd5c-39ee-429b-b93e-88e1e514fafe None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.774544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d32dd5c-39ee-429b-b93e-88e1e514fafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.775052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:16:25.775052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:16:25.775052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:16:25.776662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2566384-dd20-4c07-8791-40156868a221 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.804031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 772/1550] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:25.805334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c36d-1449-4213-b7bd-0dc7d92588fd None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.805629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c36d-1449-4213-b7bd-0dc7d92588fd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.805907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8520c36d-1449-4213-b7bd-0dc7d92588fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.806020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5d32dd5c-39ee-429b-b93e-88e1e514fafe None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.808403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5d32dd5c-39ee-429b-b93e-88e1e514fafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.817045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 779/1551] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.822066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9707-6616-4e42-b2fe-c22e39ba616d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.822066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9707-6616-4e42-b2fe-c22e39ba616d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.822066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c9707-6616-4e42-b2fe-c22e39ba616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.831871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8520c36d-1449-4213-b7bd-0dc7d92588fd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.833110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8520c36d-1449-4213-b7bd-0dc7d92588fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.844289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 773/1552] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.844568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6c3c9707-6616-4e42-b2fe-c22e39ba616d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.845708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6c3c9707-6616-4e42-b2fe-c22e39ba616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.846033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b425930-166c-4eb3-86a1-92384273aac7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.846323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b425930-166c-4eb3-86a1-92384273aac7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.846599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b425930-166c-4eb3-86a1-92384273aac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.859879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 780/1553] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.865555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.865771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.866026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.870718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9b425930-166c-4eb3-86a1-92384273aac7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.872270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b425930-166c-4eb3-86a1-92384273aac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.882973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 774/1554] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.884486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.884769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.885210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.885876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.888121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.902245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 781/1555] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.904099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.915220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.917205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.923803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d6840-11d4-4044-95ad-14429dedd918 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.929642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 775/1556] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.929864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897853f5-d9b5-44bd-bf29-6353802f3818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.930455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897853f5-d9b5-44bd-bf29-6353802f3818 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.930740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897853f5-d9b5-44bd-bf29-6353802f3818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.930904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:25.931093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897853f5-d9b5-44bd-bf29-6353802f3818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.931706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897853f5-d9b5-44bd-bf29-6353802f3818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.933693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897853f5-d9b5-44bd-bf29-6353802f3818 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.942470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572df31-714e-42ea-b931-02a58166ddb6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:25.944993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 782/1557] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:25.946259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ead50-b858-46b2-b4a2-e9aaa699cacc None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.946559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ead50-b858-46b2-b4a2-e9aaa699cacc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.946816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ead50-b858-46b2-b4a2-e9aaa699cacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.950649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b4304-2b22-461c-acfa-7e8d37131dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:25.951269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b4304-2b22-461c-acfa-7e8d37131dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.951573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b4304-2b22-461c-acfa-7e8d37131dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.951890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b4304-2b22-461c-acfa-7e8d37131dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.952584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b4304-2b22-461c-acfa-7e8d37131dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:25.954187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b4304-2b22-461c-acfa-7e8d37131dd6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:25.968658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 776/1558] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:25.969927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c8b11-832f-4cc4-8236-6343e2f6a6f5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.970212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c8b11-832f-4cc4-8236-6343e2f6a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.970490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c8b11-832f-4cc4-8236-6343e2f6a6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.974207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-742ead50-b858-46b2-b4a2-e9aaa699cacc None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.975555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-742ead50-b858-46b2-b4a2-e9aaa699cacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:25.984493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 783/1559] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:25.985829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701219-eeca-421b-b2bd-613d54a34f37 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:25.986119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701219-eeca-421b-b2bd-613d54a34f37 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:25.986381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701219-eeca-421b-b2bd-613d54a34f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:25.991904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d80c8b11-832f-4cc4-8236-6343e2f6a6f5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:25.993313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d80c8b11-832f-4cc4-8236-6343e2f6a6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.001295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 777/1560] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:26.002486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.002765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.003033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.007121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-64701219-eeca-421b-b2bd-613d54a34f37 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:26.008990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-64701219-eeca-421b-b2bd-613d54a34f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.018833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 784/1561] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:26.020101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.020385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.020656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.024016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:26.025258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.034200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 778/1562] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:26.035403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.044928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:26.045722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6398e-30f9-4e1c-9332-c83f0a57a4c0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.046135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.050829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.051457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.051732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.052064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.052722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.053052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.055027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.055719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 785/1563] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:26.057437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.077388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 779/1564] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.077388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.077699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124e7ee-78e1-4142-a58c-693cfade4371 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.084380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.085356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.085831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.086339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.087415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.088038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cb4341-b676-4737-98c6-542c2077d484 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.091204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.093621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.094235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.094510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.094779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.095614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.097376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.104853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 786/1565] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:26.105836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.110678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 780/1566] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:26.111563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.120249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ff74d-5e76-4919-9952-30f5b7ddd813 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.124799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb9d9b3-3ece-403c-aa16-87d2b53f70b0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.126956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.127570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.127850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.128237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.129076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.129463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.131540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.132261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.132885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.133164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.133472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.134130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.134433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.136061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.151572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 787/1567] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.151572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.158220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 781/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.159411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.163123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20779ee-bf0d-46f0-9ed1-551fbeb48686 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.167085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.169619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.170236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.170515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.170782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.171436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.171733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.172399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfdf111-0ee0-41e8-9d70-f2cc5f2f0df4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.173415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.179121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.179810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.180151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.180434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.181130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.181438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.183200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.186594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 788/1569] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.187441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.193862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.198530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e80fef-0466-4fa0-9852-365937f601f9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.206314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.207625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.208086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.208525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.209278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 782/1570] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.209441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:26.209743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.210220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.211793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.222427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b70eda-c9ae-4a1d-8c9d-228b6a243a50 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.226423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 789/1571] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:26.227256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.228958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.229594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.229872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.230142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.231981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.235075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.239089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c03770-5969-43ad-81c8-992a94d9ef85 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.244201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.244913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.245191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.245465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] PATH_INFO: `/v3/projects/358d32707a674dc59b3cf629f2ed323f/users/12ea13d634a4486b94a2a393d5c35214/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.264293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=358d32707a674dc59b3cf629f2ed323f, user_id=12ea13d634a4486b94a2a393d5c35214, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.265357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:16:26.265357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:16:26.265357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:16:26.267360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.270604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 783/1572] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.271433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.283896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 790/1573] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:26 2022] PUT /identity/v3/projects/358d32707a674dc59b3cf629f2ed323f/users/12ea13d634a4486b94a2a393d5c35214/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:26.284683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.343592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae702cae-140f-46e3-8bb1-f985cdda5e13 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.363438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f8260-0cfd-48b4-989a-590a80eb9b1f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.368857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.369480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.369763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.370038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.370728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.372824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.403136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 791/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 393 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.403989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.413765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.414945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.415344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.415756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] PATH_INFO: `/v3/projects/3ed2622aaff54fafa9d438e0152141d3/users/8fd40d2528354adcad63e59310cbfad3/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.432951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ed2622aaff54fafa9d438e0152141d3, user_id=8fd40d2528354adcad63e59310cbfad3, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.435754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.449930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 784/1575] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:26 2022] PUT /identity/v3/projects/3ed2622aaff54fafa9d438e0152141d3/users/8fd40d2528354adcad63e59310cbfad3/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:26.453709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.474669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a568b7c-ebe6-4dcc-8647-4d02ee6ee3d9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.514781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59f03-d800-49f8-9d94-f3399de953c6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.519887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.520649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.520932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.521201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.521829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.523781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.528523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.534213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.534835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.535117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.535394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.536151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.538195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.543360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.559722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 785/1576] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.559722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.576555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 792/1577] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.576555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.624585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880d9dc-ccd9-4e4e-97bd-0d76fd426a5a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.656401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772b7a4-6d42-43ae-bdc1-dc6f74ddb0ab admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.661881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.662612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.662893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.663164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.664300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.666665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.682518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c596b-6b8f-4478-9a7a-54c213230b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.683163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c596b-6b8f-4478-9a7a-54c213230b0d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.683454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c596b-6b8f-4478-9a7a-54c213230b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.684370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c596b-6b8f-4478-9a7a-54c213230b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.685002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c596b-6b8f-4478-9a7a-54c213230b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.687196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c596b-6b8f-4478-9a7a-54c213230b0d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.696336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 793/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.697157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.718964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 786/1579] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.720434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.720790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.721126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.750076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] MFA Rules not processed for user `12ea13d634a4486b94a2a393d5c35214`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:26.751374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.762673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720eeb6c-7e4a-4112-bf89-d9a967908cfb admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.820473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 787/1580] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:26.821337 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.825424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e5c1a1-4a64-4fa9-ba2a-624b6c8641b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.826044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5c1a1-4a64-4fa9-ba2a-624b6c8641b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.826328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5c1a1-4a64-4fa9-ba2a-624b6c8641b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.826603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5c1a1-4a64-4fa9-ba2a-624b6c8641b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.827237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5c1a1-4a64-4fa9-ba2a-624b6c8641b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.829244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e5c1a1-4a64-4fa9-ba2a-624b6c8641b9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.833599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ac40-631a-404a-a6c8-1bcc0fa68663 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.838093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.838680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.838952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.839219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.840500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.842563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.850993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.851234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 794/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.852887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.853189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.853469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.866926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 788/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.867567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.869845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:26.876086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:26.877231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:26.878325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2393131-28ef-4b00-85da-72f2f0c5e177 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.883440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.884170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.884444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.884736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.885245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 795/1583] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:26.885391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.886004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.887804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.896029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd5fe96-7a20-4eca-b52b-2decba882f76 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.900855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.901472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.901746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.902015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.903247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.905583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.914159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 789/1584] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.914159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.926243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b46e712-fb45-4643-a50f-43c447b3e92e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.929781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 796/1585] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.930718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.933303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.933988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.934265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.934536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.935160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.937228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.940466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf4725-ddc1-446d-9972-fa58cae90f38 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.944957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.945542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.945874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.946076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.947038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.948918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.959568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 790/1586] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.960422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.970744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0141ad-0cdb-48bf-9014-cb8a008cd90e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.978114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 797/1587] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:26.978288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.978405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:26.978512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.978512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.978512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.978512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.979177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:26.986554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821e2a34-6298-4532-8407-2e5baad51f64 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:26.991084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:26.991676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:26.991978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:26.992241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:26.992872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:26.994503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.006186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 798/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.007638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 791/1589] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:26 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:27.008821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.008953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.019457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77ab45-95cd-4149-8552-f393087b3d8d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.069959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56713a6-a54f-4b9e-8a60-84f5710039f3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.073514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.074707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.074974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.075236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.083389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.084135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.084505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.084954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.085596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.087542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.097943 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 799/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.098767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.108642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717949a-82ec-4592-a20f-98928c7260a5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.113562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.114162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.114444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.114721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.115359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.117394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.128314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 800/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.131997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.138417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.139865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.142468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b1feb-1e2d-4000-86c5-542dcb663b9e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.147421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.148039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.148324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.148600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.149237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.150152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 792/1592] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:27.151071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.153452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.161187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d23d9d-5801-4946-92cf-b1edcd7b9e20 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.169081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 801/1593] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.169255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.169376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.169468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.169468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.169468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.169468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.170215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.180251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0185825-35f9-4833-81ab-e08128fcebe8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.181509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 793/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.182418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.188538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.189296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.189443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.189702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.191163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.193042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.194557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08da38-8357-4d70-a60c-3a95de2fcc82 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.200590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.201627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.201905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.202186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.203043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.204526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 802/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.205283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.208514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.215354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2323a855-dd79-4b67-845f-3dffed3fb40e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.220021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.220626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.220970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.221151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.222183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.224130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.224904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 794/1596] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.225823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.238963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf6759-9fc1-485c-b570-41bcc4b29f9d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.243894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.244590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.244922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.245203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.245924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.247590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.251175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 803/1597] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:27 2022] POST /identity/v3/users => generated 291 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:27.251175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.260697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54818d59-0f5d-427c-b56b-09a47e448544 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.266970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 795/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.266970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.269002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.269619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.269893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.270156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.270930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.272462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.276806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb4e25e-952f-4178-be7b-e761d25c918c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.282361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.283043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.283444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.283976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.284295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 804/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.285151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.287829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.289775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.292556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.296153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf464cd-f07b-43d9-acec-63681289bb9e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.301655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.302260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.302706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 796/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.304191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.305935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.306316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.307183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.308982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.317764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f58a5-775c-45a8-918b-f3a5f3703982 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.320001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 805/1601] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.320824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.322900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.323608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.324099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.324563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.325274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.326939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.331518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fc22e-fd01-4601-86d0-d86dada23f08 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.336688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.337351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.337811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.338086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] PATH_INFO: `/v3/projects/fef0844c64fa404a935cab89acdae017/users/560c9fb874fd4eba9c92133b56ba30ee/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.342519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 797/1602] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.342519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.362468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d3199-f55a-4b6a-874e-62fd10c21e6b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.363057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fef0844c64fa404a935cab89acdae017, user_id=560c9fb874fd4eba9c92133b56ba30ee, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.366789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.368111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.368751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.369013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.369313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.370141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.372981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.383691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 806/1603] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/fef0844c64fa404a935cab89acdae017/users/560c9fb874fd4eba9c92133b56ba30ee/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.385005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.392322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 798/1604] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:27.392322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.407410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3c004-a67e-45f0-82bc-3de7380a5593 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.407600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.462804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0324b27-65a7-4ec5-94cf-43c91eee784b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.467836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.468548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.468821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.469090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] PATH_INFO: `/v3/projects/d536385d0b5f4b878c287d4aa158e7e5/users/d452a433fe3d45018e247cc9424cafbe/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.475567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.476314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.476725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.477007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] PATH_INFO: `/v3/projects/0a6178dddc42490aa849efd57af8a768/users/33571cdad79645ccab6d8e28cee3de39/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.485682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d536385d0b5f4b878c287d4aa158e7e5, user_id=d452a433fe3d45018e247cc9424cafbe, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.488425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.495389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6178dddc42490aa849efd57af8a768, user_id=33571cdad79645ccab6d8e28cee3de39, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.498414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.509152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 807/1605] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/d536385d0b5f4b878c287d4aa158e7e5/users/d452a433fe3d45018e247cc9424cafbe/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.509152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.530998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 799/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/0a6178dddc42490aa849efd57af8a768/users/33571cdad79645ccab6d8e28cee3de39/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.533345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.606526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e598442-18f4-4fad-97dd-58bf349ecd84 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.625236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f90d-c8c1-421e-ab46-47c9caa29688 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.630222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.630877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.631156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.631426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] PATH_INFO: `/v3/projects/a8942ebfe9244e41a72c00231cef4128/users/ec1b4fab350f4971947a8a045217a2b7/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.649843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8942ebfe9244e41a72c00231cef4128, user_id=ec1b4fab350f4971947a8a045217a2b7, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.652774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.666897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 800/1607] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/a8942ebfe9244e41a72c00231cef4128/users/ec1b4fab350f4971947a8a045217a2b7/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.670761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.678535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.679085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.679496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.679769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] PATH_INFO: `/v3/projects/110e38293e9d4e2f82f384406d453a74/users/57cc2451917d4ecea594e92458980f11/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.698362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110e38293e9d4e2f82f384406d453a74, user_id=57cc2451917d4ecea594e92458980f11, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.702420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.717508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 808/1608] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/110e38293e9d4e2f82f384406d453a74/users/57cc2451917d4ecea594e92458980f11/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.720766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:27.723748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.745790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7d6221-df0f-4c37-98a7-c977836d8c0d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.753521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:27.794348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7da0bab-8365-4907-bc72-97e7da6a4fe2 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:27.799129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba8d2a-147d-467b-9b3a-862c962a0315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.799939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba8d2a-147d-467b-9b3a-862c962a0315 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.800152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba8d2a-147d-467b-9b3a-862c962a0315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.800447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba8d2a-147d-467b-9b3a-862c962a0315 admin admin] PATH_INFO: `/v3/projects/2a09cea7a38e428582d7121e9e17589d/users/36eef23299f3405a8ef62e362babb67a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.817400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba8d2a-147d-467b-9b3a-862c962a0315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a09cea7a38e428582d7121e9e17589d, user_id=36eef23299f3405a8ef62e362babb67a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.819983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba8d2a-147d-467b-9b3a-862c962a0315 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.828216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535102c2-a7dd-43ec-afdc-50ca432994c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:27.828977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535102c2-a7dd-43ec-afdc-50ca432994c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.829262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535102c2-a7dd-43ec-afdc-50ca432994c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.829538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535102c2-a7dd-43ec-afdc-50ca432994c1 admin admin] PATH_INFO: `/v3/projects/9f98955fa3ef4d1a85d4166d0550548d/users/af90d77225384041ab85415589ef995e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.837937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 809/1609] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/2a09cea7a38e428582d7121e9e17589d/users/36eef23299f3405a8ef62e362babb67a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.839374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96e373-0214-4b21-ad8c-1c7dca374cda None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.839661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96e373-0214-4b21-ad8c-1c7dca374cda None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.840026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96e373-0214-4b21-ad8c-1c7dca374cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.854570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535102c2-a7dd-43ec-afdc-50ca432994c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f98955fa3ef4d1a85d4166d0550548d, user_id=af90d77225384041ab85415589ef995e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:27.857477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535102c2-a7dd-43ec-afdc-50ca432994c1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:27.874969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-3c96e373-0214-4b21-ad8c-1c7dca374cda None None] MFA Rules not processed for user `560c9fb874fd4eba9c92133b56ba30ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:27.876246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3c96e373-0214-4b21-ad8c-1c7dca374cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:27.892166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 801/1610] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:27 2022] PUT /identity/v3/projects/9f98955fa3ef4d1a85d4166d0550548d/users/af90d77225384041ab85415589ef995e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:27.892166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e777b1-1eab-4957-adc6-90a7086cf0d6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.892166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e777b1-1eab-4957-adc6-90a7086cf0d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.892166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e777b1-1eab-4957-adc6-90a7086cf0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:27.913397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-84e777b1-1eab-4957-adc6-90a7086cf0d6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:27.914618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-84e777b1-1eab-4957-adc6-90a7086cf0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:27.980882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 810/1611] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:27.982234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65017-c057-4ff4-90af-fb0402c6938f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:27.982517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65017-c057-4ff4-90af-fb0402c6938f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:27.982876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb65017-c057-4ff4-90af-fb0402c6938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.014326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 802/1612] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.014326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.014326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.014326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.058131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] MFA Rules not processed for user `ec1b4fab350f4971947a8a045217a2b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.059912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.060509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-afb65017-c057-4ff4-90af-fb0402c6938f None None] MFA Rules not processed for user `33571cdad79645ccab6d8e28cee3de39`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.061707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-afb65017-c057-4ff4-90af-fb0402c6938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.149350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 811/1613] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.155518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b764c7-50ff-45c3-a7c9-12787171df30 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.155518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b764c7-50ff-45c3-a7c9-12787171df30 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.155518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b764c7-50ff-45c3-a7c9-12787171df30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.156357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 803/1614] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.157308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.173874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.184563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c0b764c7-50ff-45c3-a7c9-12787171df30 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.185768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c0b764c7-50ff-45c3-a7c9-12787171df30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.186714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db5b22d-b4bb-4268-b631-ce43acea421c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.201399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.201638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 812/1615] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.202598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.202884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0377-6b9c-4c03-8004-31995a7947e3 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.203174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0377-6b9c-4c03-8004-31995a7947e3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.203502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0377-6b9c-4c03-8004-31995a7947e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.205381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.205857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.206723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.211594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.226301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 804/1616] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:28.227532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.229527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.253980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2edd0377-6b9c-4c03-8004-31995a7947e3 None None] MFA Rules not processed for user `af90d77225384041ab85415589ef995e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.256190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2edd0377-6b9c-4c03-8004-31995a7947e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.269513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.302050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd7039-e45b-4df5-a380-4fda50726926 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.306199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45abf0b-27a6-4a83-9fb6-21c6d600469e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.306954 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abf0b-27a6-4a83-9fb6-21c6d600469e service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.307258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abf0b-27a6-4a83-9fb6-21c6d600469e service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.307565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45abf0b-27a6-4a83-9fb6-21c6d600469e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.320135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abf0b-27a6-4a83-9fb6-21c6d600469e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.321585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45abf0b-27a6-4a83-9fb6-21c6d600469e service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.337156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 813/1617] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.338675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1ecf8-3584-4d24-941e-b1f2432d8768 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.339136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1ecf8-3584-4d24-941e-b1f2432d8768 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.339501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c1ecf8-3584-4d24-941e-b1f2432d8768 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.342217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 814/1618] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 31 12:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:28.342845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1ecf8-3584-4d24-941e-b1f2432d8768 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.352306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 805/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:28.354253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d891ca-eb7a-49b2-902d-61e5afc5915f None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.354596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d891ca-eb7a-49b2-902d-61e5afc5915f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.354880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d891ca-eb7a-49b2-902d-61e5afc5915f None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.358607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c1ecf8-3584-4d24-941e-b1f2432d8768 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.359260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 806/1620] 10.222.0.48 () {54 vars in 962 bytes} [Wed Aug 31 12:16:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:28.360183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d891ca-eb7a-49b2-902d-61e5afc5915f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.364278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.364907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.365189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.365463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.366172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.368189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.376708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d891ca-eb7a-49b2-902d-61e5afc5915f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.380754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f8d50-5f31-4b1f-87e1-8cdd1851ea6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.381383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8d50-5f31-4b1f-87e1-8cdd1851ea6c service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.381664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8d50-5f31-4b1f-87e1-8cdd1851ea6c service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.382902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f8d50-5f31-4b1f-87e1-8cdd1851ea6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.397965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8d50-5f31-4b1f-87e1-8cdd1851ea6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.400485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f8d50-5f31-4b1f-87e1-8cdd1851ea6c service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.409175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 815/1621] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/projects => generated 393 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:28.410452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.414444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 807/1622] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:28.415985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b31a0-9fbe-41c1-aa9f-a64c7002b72f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.416279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b31a0-9fbe-41c1-aa9f-a64c7002b72f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.416551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b31a0-9fbe-41c1-aa9f-a64c7002b72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.502837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-832b31a0-9fbe-41c1-aa9f-a64c7002b72f None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.507127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-832b31a0-9fbe-41c1-aa9f-a64c7002b72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.520503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527f00-b523-4c27-826f-dc65121711b6 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.528137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.529045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.529479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.529889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] PATH_INFO: `/v3/projects/2a09cea7a38e428582d7121e9e17589d/users/36eef23299f3405a8ef62e362babb67a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.532929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a09cea7a38e428582d7121e9e17589d, user_id=36eef23299f3405a8ef62e362babb67a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.540215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.576064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 816/1623] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:28 2022] PUT /identity/v3/projects/2a09cea7a38e428582d7121e9e17589d/users/36eef23299f3405a8ef62e362babb67a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:28.577691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.642698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 808/1624] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.644840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.645413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.645903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.670408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277187f-6ff3-4550-8bf8-2058710a74eb admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:28.672819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.674408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:28.674924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb17203-113c-4853-8253-a51855037eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:28.675700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb17203-113c-4853-8253-a51855037eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.676051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb17203-113c-4853-8253-a51855037eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.676327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb17203-113c-4853-8253-a51855037eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.776296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.805274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:28.844312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb17203-113c-4853-8253-a51855037eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:28.848074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb17203-113c-4853-8253-a51855037eb5 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:28.853314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 809/1625] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:28.854482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:28.860915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 817/1626] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:28.862950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:28.863417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:28.863803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:28.909148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] MFA Rules not processed for user `36eef23299f3405a8ef62e362babb67a`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:28.910931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:29.007613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5372df2-1182-49d7-880d-183fb2e09c6e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.029403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.029860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.030136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.030415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.031062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.033069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.066252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 818/1627] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:29.067212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.091983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 810/1628] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:28 2022] POST /identity/v3/users => generated 303 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:29.092912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.096658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3135b025-89d5-40ee-9ab7-6a3321e3c868 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.110164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.111004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.111469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.111843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.137366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbefa36-bcdb-411c-aaff-010f932a3f0d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.153044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.153680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.153961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.154236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.314626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.314626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.315679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.315679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.316022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 819/1629] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:29.316022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.325153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c660ee-e71a-4fd0-9519-f389cda371c5 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.329648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.330797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.331162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.334724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.355610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.358745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 811/1630] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:29.365406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.374733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.388747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5acc2-041f-4383-8cf6-dfea288373f1 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.401659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.402824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.403139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.403431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.404225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.405853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.421359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 820/1631] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:29.434111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 812/1632] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:29.437798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.475069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fb7df-c917-49b7-9971-265ab1c09347 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.485679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.486418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.486740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.486961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] PATH_INFO: `/v3/projects/107c909fff2a4a87804b49fb6a3b9ecf/users/c7611fe0f7a5429eb5783cf3605b4909/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.523446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=107c909fff2a4a87804b49fb6a3b9ecf, user_id=c7611fe0f7a5429eb5783cf3605b4909, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.531272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.571372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 821/1633] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:29 2022] PUT /identity/v3/projects/107c909fff2a4a87804b49fb6a3b9ecf/users/c7611fe0f7a5429eb5783cf3605b4909/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:29.575747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.593106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0cc8e-65da-4f75-8538-65bcf8b659d0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.736130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383db05e-b014-47e1-b58f-ceed5f9af3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.736743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db05e-b014-47e1-b58f-ceed5f9af3ac admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.737031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db05e-b014-47e1-b58f-ceed5f9af3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.737295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383db05e-b014-47e1-b58f-ceed5f9af3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.738007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383db05e-b014-47e1-b58f-ceed5f9af3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.739674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383db05e-b014-47e1-b58f-ceed5f9af3ac admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.766907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 813/1634] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:29.770806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:29.787964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab86e8a-5d3b-4f78-86b7-1d3c292d36dd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:29.800760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ac723-062e-432a-b32d-105031828858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:29.802230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac723-062e-432a-b32d-105031828858 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.802517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac723-062e-432a-b32d-105031828858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.802791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ac723-062e-432a-b32d-105031828858 admin admin] PATH_INFO: `/v3/projects/107c909fff2a4a87804b49fb6a3b9ecf/users/c7611fe0f7a5429eb5783cf3605b4909/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.807725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac723-062e-432a-b32d-105031828858 admin admin] RBAC: Authorizing `identity:create_grant(project_id=107c909fff2a4a87804b49fb6a3b9ecf, user_id=c7611fe0f7a5429eb5783cf3605b4909, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:29.814162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ac723-062e-432a-b32d-105031828858 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:29.840070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 822/1635] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:29 2022] PUT /identity/v3/projects/107c909fff2a4a87804b49fb6a3b9ecf/users/c7611fe0f7a5429eb5783cf3605b4909/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:29.851321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aadc2e-5cf2-47af-988a-e45954226b39 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:29.851725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aadc2e-5cf2-47af-988a-e45954226b39 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:29.852164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aadc2e-5cf2-47af-988a-e45954226b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:29.865306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:29.961290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f3aadc2e-5cf2-47af-988a-e45954226b39 None None] MFA Rules not processed for user `c7611fe0f7a5429eb5783cf3605b4909`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:29.962553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f3aadc2e-5cf2-47af-988a-e45954226b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:30.098566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1224b9-902e-4959-ba0a-c62dc6b200b0 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.099025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1224b9-902e-4959-ba0a-c62dc6b200b0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.099498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1224b9-902e-4959-ba0a-c62dc6b200b0 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.101203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 823/1636] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 31 12:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:30.107840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bedb2-0abc-49d5-8f3a-7c4f0a5111fe None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.108290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bedb2-0abc-49d5-8f3a-7c4f0a5111fe None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.108726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bedb2-0abc-49d5-8f3a-7c4f0a5111fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.137674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5c8bedb2-0abc-49d5-8f3a-7c4f0a5111fe None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:30.139407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5c8bedb2-0abc-49d5-8f3a-7c4f0a5111fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:30.148395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:30.268003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 814/1637] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:29 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:30.268003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa00a-0fa7-4ec8-8326-32824e05cf71 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.268465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa00a-0fa7-4ec8-8326-32824e05cf71 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.268908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfa00a-0fa7-4ec8-8326-32824e05cf71 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.279777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 815/1638] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 31 12:16:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:30.281595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa00a-0fa7-4ec8-8326-32824e05cf71 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.358304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 824/1639] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:16:30.359764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.360102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.360383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.408223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:30.411205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:30.445461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 825/1640] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:16:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:30.447765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.460022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfa00a-0fa7-4ec8-8326-32824e05cf71 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.473021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.473673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.473840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1e3da-e749-4343-8b85-c423bc6a9e68 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.473967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.474341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.482377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.483015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.483295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.483567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.494596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.498760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.500479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.503464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.515774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 826/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:30.528465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 816/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:30.698182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.732872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f988-76bc-4227-afbf-39c444a04030 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.753309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.753853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:30.753986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.754241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.754528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.765573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb248c5-b06b-45c9-b5c2-8d50c016042f service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:30.774087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a6c38-2922-4446-a39e-42e4bcddb02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:30.774795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6c38-2922-4446-a39e-42e4bcddb02c service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:30.775000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6c38-2922-4446-a39e-42e4bcddb02c service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:30.775238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a6c38-2922-4446-a39e-42e4bcddb02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:30.794737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.800403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.823479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 827/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:30.862780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a6c38-2922-4446-a39e-42e4bcddb02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:30.865311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a6c38-2922-4446-a39e-42e4bcddb02c service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:30.879300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 817/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:30 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:16:31.710463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:31.959868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3eb9e-02d6-474b-94ed-0be2cb079e66 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:31.983922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:31.985911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:31.988965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:31.989930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] PATH_INFO: `/v3/users/560c9fb874fd4eba9c92133b56ba30ee` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:31.993791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=560c9fb874fd4eba9c92133b56ba30ee)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:31.995302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: WARNING py.warnings [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:16:31.995302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: warnings.warn(msg) Aug 31 12:16:31.995302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: Aug 31 12:16:31.996989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:32.194643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '560c9fb874fd4eba9c92133b56ba30ee'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:32.226883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '560c9fb874fd4eba9c92133b56ba30ee'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:32.228089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '560c9fb874fd4eba9c92133b56ba30ee'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:32.228745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '560c9fb874fd4eba9c92133b56ba30ee'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:32.296118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '560c9fb874fd4eba9c92133b56ba30ee'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:32.298221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:32.334748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 828/1645] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:31 2022] DELETE /identity/v3/users/560c9fb874fd4eba9c92133b56ba30ee => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:32.339562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.340164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.340164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.379043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:32.384213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:32.487235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:32.662711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 818/1646] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:16:32.711890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:32.713851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:32.919203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4469f-cb10-4a92-a641-10d9559ecf33 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:32.929417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:32.929880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:32.930168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:32.930441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:32.952670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:32.955698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:32.988170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 829/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:36.425210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.427810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:36.476692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746313d-e66e-4a34-bfe6-3891ee5a9e24 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.493876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.496144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.496630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.497111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] PATH_INFO: `/v3/users/12ea13d634a4486b94a2a393d5c35214` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.506418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ea13d634a4486b94a2a393d5c35214)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.510003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.539591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:36.545346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:36.611938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd40238-2b2b-411c-a357-3cb7082c522b service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:36.664190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:36.680424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:36.681954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:36.685455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] PATH_INFO: `/v3/projects/fef0844c64fa404a935cab89acdae017` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:36.690790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] RBAC: Authorizing `identity:delete_project(project_id=fef0844c64fa404a935cab89acdae017)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:36.708254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:36.833250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ea13d634a4486b94a2a393d5c35214'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:36.871852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ea13d634a4486b94a2a393d5c35214'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:36.875984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ea13d634a4486b94a2a393d5c35214'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:36.968658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ea13d634a4486b94a2a393d5c35214'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:36.971293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af74e08b-ac10-4cff-b5d3-51509ad574a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ea13d634a4486b94a2a393d5c35214'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.025723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 819/1648] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:36 2022] DELETE /identity/v3/users/12ea13d634a4486b94a2a393d5c35214 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:37.029516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fef0844c64fa404a935cab89acdae017', 'request_id': 'req-72f3e181-1152-4a08-a820-cf42d80b51da'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.029789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.029789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.029789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.048307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fef0844c64fa404a935cab89acdae017', 'request_id': 'req-72f3e181-1152-4a08-a820-cf42d80b51da'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.059415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:37.070750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fef0844c64fa404a935cab89acdae017', 'request_id': 'req-72f3e181-1152-4a08-a820-cf42d80b51da'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.072215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:37.136488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] The token cache is being invalidate because project fef0844c64fa404a935cab89acdae017 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:37.138597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.142704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-72f3e181-1152-4a08-a820-cf42d80b51da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.150808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 830/1649] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:36 2022] DELETE /identity/v3/projects/fef0844c64fa404a935cab89acdae017 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:37.158263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.158476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.162203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.232601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:37.235562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:37.296944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 820/1650] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:37.298352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.307574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:37.349858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005457b3-10f7-48a8-be72-9c7be52314a7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.368347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.369010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.369286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.369561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] PATH_INFO: `/v3/users/33571cdad79645ccab6d8e28cee3de39` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.376947 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33571cdad79645ccab6d8e28cee3de39)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.386172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.386853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 831/1651] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:37.386853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:37.387897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:37.432658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:37.544273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:37.566803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33571cdad79645ccab6d8e28cee3de39'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.575536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a42d5a-8fb8-48d7-869d-4717940546a6 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:37.589181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569d7ee2-1109-4ed2-a372-bc62a2df37b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:37.593964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7ee2-1109-4ed2-a372-bc62a2df37b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.594314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7ee2-1109-4ed2-a372-bc62a2df37b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.594596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569d7ee2-1109-4ed2-a372-bc62a2df37b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.595837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33571cdad79645ccab6d8e28cee3de39'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.596385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33571cdad79645ccab6d8e28cee3de39'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.650931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d7ee2-1109-4ed2-a372-bc62a2df37b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:37.656898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33571cdad79645ccab6d8e28cee3de39'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.663749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-636b0b04-80fa-48c9-9136-d483a0c78f57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33571cdad79645ccab6d8e28cee3de39'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:37.665881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569d7ee2-1109-4ed2-a372-bc62a2df37b4 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:37.715331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 832/1652] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:37.716906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.717383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.717862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.737958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 821/1653] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:37 2022] DELETE /identity/v3/users/33571cdad79645ccab6d8e28cee3de39 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:37.739694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:37.740223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:37.740524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:37.784643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:37.785884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:37.789688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:37.796334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:38.072760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 822/1654] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:38.126882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 833/1655] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:38.132030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.138336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.139742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:38.183924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9b2a6-6c1a-4b22-a3ba-06ffb7bbad5f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.210922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.211563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.218271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.219232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.228446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:38.228834 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.238019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.321166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ce4fa-c63f-45b0-9fcc-df1719f4c5fc None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.322762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 823/1656] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:38.325520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.329890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:38.341124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.341762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.342042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.342314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.366647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262886b-89e1-4691-9e46-4bada4664b78 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.369923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.372234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.381899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.385160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.386832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.387656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] PATH_INFO: `/v3/users/ec1b4fab350f4971947a8a045217a2b7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.391491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1b4fab350f4971947a8a045217a2b7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.396052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 834/1657] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:38.397529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.398195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.424265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4ed8b9-c280-4ba7-9b00-16a3a1eb0b3d service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:38.444553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:38.445235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.445525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.446059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.447757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:38.455117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:38.529267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 835/1658] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:38 2022] POST /identity/v3/projects => generated 365 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:38.533314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:38.554950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1b4fab350f4971947a8a045217a2b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:38.575808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1b4fab350f4971947a8a045217a2b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:38.576516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1b4fab350f4971947a8a045217a2b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:38.603497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1b4fab350f4971947a8a045217a2b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:38.612186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bf0f6481-0777-499a-ba3d-ffc48ee7f70c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1b4fab350f4971947a8a045217a2b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:38.652589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 824/1659] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:38 2022] DELETE /identity/v3/users/ec1b4fab350f4971947a8a045217a2b7 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:38.654282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:38.654577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:38.654854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:38.715048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:38.716356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:38.731618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.754128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:38.795420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931fee9a-fca3-4c99-8b6f-52107e28b95a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.000277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 825/1660] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:39.132694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.137589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.138084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.138368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.144422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.149133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.227729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 836/1661] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:38 2022] POST /identity/v3/users => generated 283 bytes in 697 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:16:39.233800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.234910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:39.265357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25b590-5e3e-4af8-ade7-363002c872fa None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.275630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.276278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.276556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.277342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.278009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.279699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.319578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.332990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 826/1662] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:39.341151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e7d97-edfe-4870-b763-8ce9617dc85d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.355636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2d028-1be7-4555-be9d-c5a66ec2e19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.356315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2d028-1be7-4555-be9d-c5a66ec2e19b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.356595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2d028-1be7-4555-be9d-c5a66ec2e19b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.356867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2d028-1be7-4555-be9d-c5a66ec2e19b admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.357553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2d028-1be7-4555-be9d-c5a66ec2e19b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.359202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2d028-1be7-4555-be9d-c5a66ec2e19b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.395168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.404251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 837/1663] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:39.409154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbb2efc-d472-4ba0-8ef7-081db543865c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.421843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.422629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.422914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.424497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] PATH_INFO: `/v3/projects/d3988b6a0ae44f42982347f4ac2fcb9f/users/f4d8c85894d8499a94b84b859184c20d/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.456311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3988b6a0ae44f42982347f4ac2fcb9f, user_id=f4d8c85894d8499a94b84b859184c20d, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.463971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.494849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 827/1664] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:39 2022] PUT /identity/v3/projects/d3988b6a0ae44f42982347f4ac2fcb9f/users/f4d8c85894d8499a94b84b859184c20d/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:16:39.506985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81e81-4466-44d8-af14-5cf04d935f16 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.507518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81e81-4466-44d8-af14-5cf04d935f16 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.507798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef81e81-4466-44d8-af14-5cf04d935f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.532776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.534564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:39.600936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6ef81e81-4466-44d8-af14-5cf04d935f16 None None] MFA Rules not processed for user `f4d8c85894d8499a94b84b859184c20d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:39.601647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6ef81e81-4466-44d8-af14-5cf04d935f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:39.721806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364961a-294d-4728-a999-e307217af7cf admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.727939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.729415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.730426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.730882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.780112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 838/1665] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:39.781616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.781940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.782215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.817567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] MFA Rules not processed for user `57cc2451917d4ecea594e92458980f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:39.818704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:39.857331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.858971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.884522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 828/1666] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:16:39.885566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.889200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:39.896767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:39.914951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c5c3d6-4f04-42bc-acff-740a54af229f service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.930603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.931658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.931939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.932245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] PATH_INFO: `/v3/projects/358d32707a674dc59b3cf629f2ed323f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.934762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] RBAC: Authorizing `identity:delete_project(project_id=358d32707a674dc59b3cf629f2ed323f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.935808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: WARNING py.warnings [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 31 12:16:39.935808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: warnings.warn(msg) Aug 31 12:16:39.935808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: Aug 31 12:16:39.937219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:39.938197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 839/1667] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:39.939456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:39.955636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f172e9-a37a-4a84-b595-1fcb27169990 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:39.963285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9cd2a0-f8bc-4b2d-832c-dad1c54941c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:39.963937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd2a0-f8bc-4b2d-832c-dad1c54941c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:39.965294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd2a0-f8bc-4b2d-832c-dad1c54941c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:39.965589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9cd2a0-f8bc-4b2d-832c-dad1c54941c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:39.966247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd2a0-f8bc-4b2d-832c-dad1c54941c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:39.968599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9cd2a0-f8bc-4b2d-832c-dad1c54941c6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.016112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.022098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 840/1668] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:39 2022] POST /identity/v3/projects => generated 365 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:40.023267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.023728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.024217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.054830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] MFA Rules not processed for user `57cc2451917d4ecea594e92458980f11`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:40.056372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.087975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358d32707a674dc59b3cf629f2ed323f', 'request_id': 'req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.106167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358d32707a674dc59b3cf629f2ed323f', 'request_id': 'req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.153218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358d32707a674dc59b3cf629f2ed323f', 'request_id': 'req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.182066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] The token cache is being invalidate because project 358d32707a674dc59b3cf629f2ed323f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:40.182365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.184957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.188130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 829/1669] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:39 2022] DELETE /identity/v3/projects/358d32707a674dc59b3cf629f2ed323f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:40.191560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.194589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.209067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 841/1670] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:40.211008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.215014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.350922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958dc0a-ae36-4998-b61b-5a1c6fb7003a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.364150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.364792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.365076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.365355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.366016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.369258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.383721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949edff-033f-4e48-9abb-a9916220d510 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.401339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.403121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.404759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.405941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] PATH_INFO: `/v3/users/36eef23299f3405a8ef62e362babb67a` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.409707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36eef23299f3405a8ef62e362babb67a)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.418130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.418272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 830/1671] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:40 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:40.419137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.427141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.574687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36eef23299f3405a8ef62e362babb67a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.588905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36eef23299f3405a8ef62e362babb67a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.591316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36eef23299f3405a8ef62e362babb67a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.596762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36eef23299f3405a8ef62e362babb67a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.627026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8f453-aaf0-418d-bac7-f12f5d174e96 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.627254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.631322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36eef23299f3405a8ef62e362babb67a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:40.643047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.643690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.643993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.644276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.648234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.669158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.670803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.677843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 842/1672] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:40 2022] DELETE /identity/v3/users/36eef23299f3405a8ef62e362babb67a => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:40.681931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.686721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.709193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 831/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:40.715127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.720456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:40.756435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63eef5f-524c-41ce-8ab6-ba0e64f43815 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.826818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:40.908644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cefef-6b38-47ed-91c3-59b5361dd275 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.914668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.915527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.916067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.921556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.922854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.924166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.925746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.926078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.926591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.927346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] PATH_INFO: `/v3/projects/0a6178dddc42490aa849efd57af8a768` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:40.930944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6178dddc42490aa849efd57af8a768)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:40.936985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:40.944606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 832/1674] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:40.949871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:40.988156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41d56f-2ee6-4612-a16c-a8ff0407f32a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:40.994527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:40.995810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:40.996330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:40.996800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] PATH_INFO: `/v3/projects/ded86f6a4704437ab3f2b2e9cf8e0a6c/users/3d112290e4ef4a2abc5bbb180c027f7a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.042589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded86f6a4704437ab3f2b2e9cf8e0a6c, user_id=3d112290e4ef4a2abc5bbb180c027f7a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.049182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.051757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6178dddc42490aa849efd57af8a768', 'request_id': 'req-651a20cb-b08e-40e6-a866-d83262e87d55'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.068998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6178dddc42490aa849efd57af8a768', 'request_id': 'req-651a20cb-b08e-40e6-a866-d83262e87d55'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.069775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 833/1675] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:40 2022] PUT /identity/v3/projects/ded86f6a4704437ab3f2b2e9cf8e0a6c/users/3d112290e4ef4a2abc5bbb180c027f7a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:16:41.076510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.085952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6178dddc42490aa849efd57af8a768', 'request_id': 'req-651a20cb-b08e-40e6-a866-d83262e87d55'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.109698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] The token cache is being invalidate because project 0a6178dddc42490aa849efd57af8a768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:41.110264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.111992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.114998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 843/1676] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:40 2022] DELETE /identity/v3/projects/0a6178dddc42490aa849efd57af8a768 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:41.119250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.122761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:41.249438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da0c386-b212-4d81-b00f-200366e818b0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.265556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a20cb-b08e-40e6-a866-d83262e87d55 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.265939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.266575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.266850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.267122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.267777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.269423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.277439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.278106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.278388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.280043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] PATH_INFO: `/v3/users/c7611fe0f7a5429eb5783cf3605b4909` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.281393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7611fe0f7a5429eb5783cf3605b4909)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.283368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.294243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 834/1677] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:41.297844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.300644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:41.335397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:41.337062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4b69e-afc5-4686-aee5-1a1bfa1a280d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.350431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bda9a-5e65-4c0e-894e-f7eb09ca3c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.351131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bda9a-5e65-4c0e-894e-f7eb09ca3c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.351418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bda9a-5e65-4c0e-894e-f7eb09ca3c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.351696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bda9a-5e65-4c0e-894e-f7eb09ca3c3b admin admin] PATH_INFO: `/v3/projects/ded86f6a4704437ab3f2b2e9cf8e0a6c/users/3d112290e4ef4a2abc5bbb180c027f7a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.357959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bda9a-5e65-4c0e-894e-f7eb09ca3c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded86f6a4704437ab3f2b2e9cf8e0a6c, user_id=3d112290e4ef4a2abc5bbb180c027f7a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.365964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bda9a-5e65-4c0e-894e-f7eb09ca3c3b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.387626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7611fe0f7a5429eb5783cf3605b4909'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.393264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 835/1678] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:41 2022] PUT /identity/v3/projects/ded86f6a4704437ab3f2b2e9cf8e0a6c/users/3d112290e4ef4a2abc5bbb180c027f7a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:41.404596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7611fe0f7a5429eb5783cf3605b4909'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.404807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb504-1b0b-459f-86d6-583e38649a6c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.405096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb504-1b0b-459f-86d6-583e38649a6c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.405270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7611fe0f7a5429eb5783cf3605b4909'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.405436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb504-1b0b-459f-86d6-583e38649a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.405902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7611fe0f7a5429eb5783cf3605b4909'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.435441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7611fe0f7a5429eb5783cf3605b4909'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:41.462308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 844/1679] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:41 2022] DELETE /identity/v3/users/c7611fe0f7a5429eb5783cf3605b4909 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:41.469376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d06eb504-1b0b-459f-86d6-583e38649a6c None None] MFA Rules not processed for user `3d112290e4ef4a2abc5bbb180c027f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:41.471822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d06eb504-1b0b-459f-86d6-583e38649a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:41.663870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 836/1680] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:16:41.680265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:41.681768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:41.790087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497aa21b-abf7-43f3-91b7-d1616771acaa admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:41.795671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:41.796634 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:41.797105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:41.797573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:41.816200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:41.822927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:41.857802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 845/1681] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:41 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:42.272314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.272816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.273032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.421970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:42.481655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] MFA Rules not processed for user `8fd40d2528354adcad63e59310cbfad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:42.482036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:42.561656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.563265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:42.760663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 837/1682] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 490 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:42.762645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:42.764655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:42.775302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990d011-a212-40ee-afc3-22f02bdb0d05 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.808991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.811424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.813195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.814865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] PATH_INFO: `/v3/projects/a8942ebfe9244e41a72c00231cef4128` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.817330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8942ebfe9244e41a72c00231cef4128)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.827327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:42.833773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edea37-5113-4f0b-8664-bc262db80fe3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:42.880434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:42.884692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:42.885106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:42.885305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] PATH_INFO: `/v3/projects/2a09cea7a38e428582d7121e9e17589d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:42.891788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a09cea7a38e428582d7121e9e17589d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:42.894606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.007100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.021856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a09cea7a38e428582d7121e9e17589d', 'request_id': 'req-f1db1164-6e40-499a-99c5-a48e09d8f067'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.030317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a09cea7a38e428582d7121e9e17589d', 'request_id': 'req-f1db1164-6e40-499a-99c5-a48e09d8f067'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.037318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8942ebfe9244e41a72c00231cef4128', 'request_id': 'req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.038271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a09cea7a38e428582d7121e9e17589d', 'request_id': 'req-f1db1164-6e40-499a-99c5-a48e09d8f067'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.053951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8942ebfe9244e41a72c00231cef4128', 'request_id': 'req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.070102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8942ebfe9244e41a72c00231cef4128', 'request_id': 'req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.100033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] The token cache is being invalidate because project a8942ebfe9244e41a72c00231cef4128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:43.100375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.102150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] The token cache is being invalidate because project 2a09cea7a38e428582d7121e9e17589d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:43.102452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.104552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d8ee0b94-f1d4-45bc-88b5-80e393612c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.107739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 846/1683] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:42 2022] DELETE /identity/v3/projects/a8942ebfe9244e41a72c00231cef4128 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:43.113011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.113772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269f3d4-58a3-4520-a377-eec91e06abdb None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.114055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269f3d4-58a3-4520-a377-eec91e06abdb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.114328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b269f3d4-58a3-4520-a377-eec91e06abdb None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.114855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 838/1684] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:42 2022] DELETE /identity/v3/projects/2a09cea7a38e428582d7121e9e17589d => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:43.119700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.119847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 847/1685] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 31 12:16:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:43.121373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269f3d4-58a3-4520-a377-eec91e06abdb None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.121483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:43.123219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b269f3d4-58a3-4520-a377-eec91e06abdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:43.297917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b269f3d4-58a3-4520-a377-eec91e06abdb None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.302870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1db1164-6e40-499a-99c5-a48e09d8f067 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.304551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.305586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.306194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.307546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] PATH_INFO: `/v3/users/af90d77225384041ab85415589ef995e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.309334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.309488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af90d77225384041ab85415589ef995e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.310087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.310428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.310767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.312284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.312989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:43.349622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.422363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af90d77225384041ab85415589ef995e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.441764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af90d77225384041ab85415589ef995e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.442641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af90d77225384041ab85415589ef995e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.443501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af90d77225384041ab85415589ef995e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.454786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.456818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.465221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3f284aee-9969-494e-92fc-45a337715dc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af90d77225384041ab85415589ef995e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.476544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 839/1686] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:43 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:43.477759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:43.484836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:43.506419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 848/1687] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:43 2022] DELETE /identity/v3/users/af90d77225384041ab85415589ef995e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:43.508096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed724-5064-4ff4-a8cb-a0333079cec6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.510817 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05faa8da-5153-4960-bb4b-1dfa04c90217 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:43.521535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed724-5064-4ff4-a8cb-a0333079cec6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.524142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ed724-5064-4ff4-a8cb-a0333079cec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.581739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-220ed724-5064-4ff4-a8cb-a0333079cec6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:43.583981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-220ed724-5064-4ff4-a8cb-a0333079cec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:43.636357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:43.637030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.637459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.637738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] PATH_INFO: `/v3/users/f4d8c85894d8499a94b84b859184c20d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.644762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d8c85894d8499a94b84b859184c20d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:43.646805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:43.766057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d8c85894d8499a94b84b859184c20d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.780828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:43.786965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d8c85894d8499a94b84b859184c20d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.789413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d8c85894d8499a94b84b859184c20d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.836007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d8c85894d8499a94b84b859184c20d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.837250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-29ca2ada-2f44-4919-9b93-b7222fd8c649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d8c85894d8499a94b84b859184c20d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:43.838123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 849/1688] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:43.845478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.849949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.850514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.888438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 840/1689] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:43 2022] DELETE /identity/v3/users/f4d8c85894d8499a94b84b859184c20d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:43.892693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5adf-723d-450c-9a85-d23a8cc4a2eb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:43.892965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5adf-723d-450c-9a85-d23a8cc4a2eb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:43.896400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea5adf-723d-450c-9a85-d23a8cc4a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:43.921249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:43.922867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.053035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-feea5adf-723d-450c-9a85-d23a8cc4a2eb None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.054981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-feea5adf-723d-450c-9a85-d23a8cc4a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.093777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:44.117934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 850/1690] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.127682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.129511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.149281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e881fc95-30ae-41eb-a92c-92ac0db2cd97 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.157621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 841/1691] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:16:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.160421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673a9f-15bf-4d20-af8a-76b0fd414bf9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.162973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673a9f-15bf-4d20-af8a-76b0fd414bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.163863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.164877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.165291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a673a9f-15bf-4d20-af8a-76b0fd414bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.166375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.168380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] PATH_INFO: `/v3/projects/107c909fff2a4a87804b49fb6a3b9ecf` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.177336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=107c909fff2a4a87804b49fb6a3b9ecf)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.180862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.231709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9a673a9f-15bf-4d20-af8a-76b0fd414bf9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.233341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9a673a9f-15bf-4d20-af8a-76b0fd414bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.254849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 842/1692] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.257344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99e87-f7bf-4cc4-8f3e-5fd621cb3627 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.257901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99e87-f7bf-4cc4-8f3e-5fd621cb3627 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.258397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed99e87-f7bf-4cc4-8f3e-5fd621cb3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.283328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107c909fff2a4a87804b49fb6a3b9ecf', 'request_id': 'req-a7e561ad-2978-42c0-84a1-753d63ae5f03'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:44.292874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107c909fff2a4a87804b49fb6a3b9ecf', 'request_id': 'req-a7e561ad-2978-42c0-84a1-753d63ae5f03'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:44.304099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9ed99e87-f7bf-4cc4-8f3e-5fd621cb3627 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.311475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9ed99e87-f7bf-4cc4-8f3e-5fd621cb3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.313403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107c909fff2a4a87804b49fb6a3b9ecf', 'request_id': 'req-a7e561ad-2978-42c0-84a1-753d63ae5f03'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:44.335247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] The token cache is being invalidate because project 107c909fff2a4a87804b49fb6a3b9ecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:44.337186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:44.338116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a7e561ad-2978-42c0-84a1-753d63ae5f03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:44.344341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 851/1693] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:44 2022] DELETE /identity/v3/projects/107c909fff2a4a87804b49fb6a3b9ecf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:44.346851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.347597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.347849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.395466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.397262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.458671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 843/1694] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.460335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.460628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.460904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.487753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.489069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.507095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 844/1695] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.507095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.507095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.547139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 852/1696] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.551103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.558916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.590627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:44.633630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873500a2-411c-4df1-a635-00aad8882a02 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.646222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.649489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.649867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.650200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.657226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.687543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.690511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b9cb0-0041-4ec3-9356-f7b03a361ab8 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.727502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c09cd-562d-4d5e-9376-e3b4f78dd528 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.735743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 845/1697] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:44.740943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f3b0b-5cec-4147-b0a1-c9d219c983cc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.741518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f3b0b-5cec-4147-b0a1-c9d219c983cc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.742098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f3b0b-5cec-4147-b0a1-c9d219c983cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.745205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.746053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.746335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.746610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.769714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.785563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-8b7f3b0b-5cec-4147-b0a1-c9d219c983cc None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.786943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8b7f3b0b-5cec-4147-b0a1-c9d219c983cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.809596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 846/1698] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:44.811336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.811635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.812002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.827736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.835270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:44.872436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] MFA Rules not processed for user `d452a433fe3d45018e247cc9424cafbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:44.873670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:44.877958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 853/1699] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:44.880742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:44.918789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177fabda-3a07-4f20-8801-21e02e5dd32b service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:44.935033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:44.936103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:44.937912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:44.939086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:44.941708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:44.942299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:44.947376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.000355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 854/1700] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:45.004711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.006182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:45.025380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132e406-bcb6-4974-99e1-724ed83058a7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.045247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 847/1701] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:45.045835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.046616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.047602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.047843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.048809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.049876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:45.050250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.052236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15be2818-dd3f-4e84-9a44-23ec1b2cc6d4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.054600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:45.087761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661093a4-028d-4e51-acec-1ef1afbe6488 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.090578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 855/1702] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:45.093534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299aadb-277b-4428-9bc8-479ca94df094 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.094659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299aadb-277b-4428-9bc8-479ca94df094 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.095321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299aadb-277b-4428-9bc8-479ca94df094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.096897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.099437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.099780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.100172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.132317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.134175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.149596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f299aadb-277b-4428-9bc8-479ca94df094 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:45.153844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f299aadb-277b-4428-9bc8-479ca94df094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:45.159488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 848/1703] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:45.159925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.175727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 856/1704] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:45.178515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.178754 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.179525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.186027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16376702-bd58-4d6a-bbf7-c7486b7ee1b3 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.199602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.200920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.201097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.201461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.203973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.208026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.228357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] MFA Rules not processed for user `d452a433fe3d45018e247cc9424cafbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:45.233650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:45.253151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 857/1705] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:45.266299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.292284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 849/1706] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:45 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:45.293299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a22c5-e074-442d-b3d7-5205f8310b0f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.297115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.435630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.436337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.436564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.436837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.437475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.439398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.501043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82391a58-3af8-4d18-a4f2-e5f4c4aff3f1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.509399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.510653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.510928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.511726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.512616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:45.513494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.515234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.534572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 850/1707] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:45.536041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.539046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:45.552509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 858/1708] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:45 2022] POST /identity/v3/projects => generated 369 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:45.556784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.688203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4299180d-8dea-4f2b-a26a-79518a225358 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.695847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.696818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.697101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.697411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.698119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.701769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.706392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b6870-2ed9-4009-b91b-56b9419bfeb4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.714735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:45.784941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 859/1709] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:45 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:45.788266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:45.814700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:45.844765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6fbda6-00c2-4641-88a0-907480feb697 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:45.875255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.875916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.876319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.876561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.877113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:45.878185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:45.878668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:45.879133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:45.880270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:45.899027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:45.996791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 860/1710] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:45 2022] POST /identity/v3/projects => generated 401 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:46.004819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.110045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.111800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.142485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 851/1711] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:45 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:46.144206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.178258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f4a54-ec79-44b8-a781-b9d1027d9689 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.257743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499fa8e-b45f-44e9-b886-ec5e68d82214 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.265745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.266396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.266684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.266960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.267622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.270615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.331265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 861/1712] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:46 2022] POST /identity/v3/users => generated 285 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:46.334945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.336750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.362181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d12a0-9eee-4c2d-b985-43a1da473a54 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.368977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.369688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.370864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.372610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.372896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.373167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.373280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.373827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.375164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] PATH_INFO: `/v3/projects/9f98955fa3ef4d1a85d4166d0550548d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.380552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f98955fa3ef4d1a85d4166d0550548d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.380955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.382643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.413786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 852/1713] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:46.413786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.418583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.491384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f98955fa3ef4d1a85d4166d0550548d', 'request_id': 'req-36d068b8-058c-4996-86f3-852e96dafd0a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:46.510041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f98955fa3ef4d1a85d4166d0550548d', 'request_id': 'req-36d068b8-058c-4996-86f3-852e96dafd0a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:46.530879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f98955fa3ef4d1a85d4166d0550548d', 'request_id': 'req-36d068b8-058c-4996-86f3-852e96dafd0a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:46.557766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] The token cache is being invalidate because project 9f98955fa3ef4d1a85d4166d0550548d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:46.558591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:46.563715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:46.568773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 862/1714] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:46 2022] DELETE /identity/v3/projects/9f98955fa3ef4d1a85d4166d0550548d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:46.569661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.571424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.618273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37139387-2914-49dc-9c49-99fe2eb59749 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.656102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:46.706263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:INSERT=7,keystone:SELECT=86,keystone:DELETE=7 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:46.748882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.750615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.751210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.751499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.758651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.769653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d068b8-058c-4996-86f3-852e96dafd0a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.781372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.782251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.782691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.783125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.784083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.787423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.799208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.802057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.823266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 863/1715] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:46 2022] POST /identity/v3/users => generated 301 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:46.824780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.831923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.842486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 853/1716] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:46.844848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.847799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.878376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63224ad9-1ce8-4f25-b135-ade1949c0303 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.883037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31285546-bebc-4e9e-ae15-0b3d6978d63e service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:46.893182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.893436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:46.894015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.894270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:46.894516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.894767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] PATH_INFO: `/v3/projects/d3988b6a0ae44f42982347f4ac2fcb9f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.894910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:46.895160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:46.897637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.901914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3988b6a0ae44f42982347f4ac2fcb9f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:46.903019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.904508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:46.940246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 854/1717] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:46.941180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:46.950839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:46.988844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa42d8-f817-42c2-8f0d-7398ef4a0713 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.001394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3988b6a0ae44f42982347f4ac2fcb9f', 'request_id': 'req-f85d7ab7-3604-4533-a46c-66fff9e37f25'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.020126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3988b6a0ae44f42982347f4ac2fcb9f', 'request_id': 'req-f85d7ab7-3604-4533-a46c-66fff9e37f25'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.042947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3988b6a0ae44f42982347f4ac2fcb9f', 'request_id': 'req-f85d7ab7-3604-4533-a46c-66fff9e37f25'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.075528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] The token cache is being invalidate because project d3988b6a0ae44f42982347f4ac2fcb9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:47.075839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.078576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f85d7ab7-3604-4533-a46c-66fff9e37f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.083931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 864/1718] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:46 2022] DELETE /identity/v3/projects/d3988b6a0ae44f42982347f4ac2fcb9f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:47.085545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbbd94-ebd9-4c6d-952f-80d4a9eaad89 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.085833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbbd94-ebd9-4c6d-952f-80d4a9eaad89 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.086102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbbd94-ebd9-4c6d-952f-80d4a9eaad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.155619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-19fbbd94-ebd9-4c6d-952f-80d4a9eaad89 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:47.163253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-19fbbd94-ebd9-4c6d-952f-80d4a9eaad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.267065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.272952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.275832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.276867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.279391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:47.283263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:47.367990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 855/1719] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:47.367990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.372075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.413683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ca079-f9c4-4012-bd14-9f6a5b9792dd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.429887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.430972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.431457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.431934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.433668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:47.437570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:47.448425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 865/1720] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:47.448425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e4be-c3ff-43ab-aa7c-73448347ab67 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.448425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e4be-c3ff-43ab-aa7c-73448347ab67 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.448425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1837e4be-c3ff-43ab-aa7c-73448347ab67 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.460829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 866/1721] 10.222.0.48 () {54 vars in 912 bytes} [Wed Aug 31 12:16:47 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:16:47.462688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837e4be-c3ff-43ab-aa7c-73448347ab67 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.469332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 856/1722] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:47.469570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1837e4be-c3ff-43ab-aa7c-73448347ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.479279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.482330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.506879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1837e4be-c3ff-43ab-aa7c-73448347ab67 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.518455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.519547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.520084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.520567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.521436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:47.523902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:47.532458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b53b2-5a93-48b1-b96c-a5473c62cca6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.542238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.543488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.544021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.544819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] PATH_INFO: `/v3/users/3d112290e4ef4a2abc5bbb180c027f7a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.549635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d112290e4ef4a2abc5bbb180c027f7a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:47.552506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:47.575088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 867/1723] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:47.576578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.590190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.631871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9349b277-73a7-43cc-8822-20178e1f49fb admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:47.658767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:47.659653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d112290e4ef4a2abc5bbb180c027f7a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.661212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.669430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.670279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] PATH_INFO: `/v3/projects/4cfa925f65264051bdf8a76cd7fb5a51/users/3d8766c7feb842df9990df32a340903a/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.676120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d112290e4ef4a2abc5bbb180c027f7a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.679099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d112290e4ef4a2abc5bbb180c027f7a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.705379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cfa925f65264051bdf8a76cd7fb5a51, user_id=3d8766c7feb842df9990df32a340903a, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:47.716702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:47.724683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d112290e4ef4a2abc5bbb180c027f7a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.726902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cca85500-7d9c-4490-9174-7ab07b6f4705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d112290e4ef4a2abc5bbb180c027f7a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:47.742222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:47.760110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 857/1724] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:16:47 2022] DELETE /identity/v3/users/3d112290e4ef4a2abc5bbb180c027f7a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:47.769348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72509-65a0-4752-8879-cdaf136b8336 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:47.769581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72509-65a0-4752-8879-cdaf136b8336 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:47.769915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee72509-65a0-4752-8879-cdaf136b8336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:47.792944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 868/1725] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:47 2022] PUT /identity/v3/projects/4cfa925f65264051bdf8a76cd7fb5a51/users/3d8766c7feb842df9990df32a340903a/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:47.792944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:47.792944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.832312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-dee72509-65a0-4752-8879-cdaf136b8336 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:47.832312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dee72509-65a0-4752-8879-cdaf136b8336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:47.880151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.014265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418544c9-2548-4f97-b757-e6c74e304958 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.018126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 858/1726] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:48.023301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a27cc-8b44-406d-831e-50f69d356cf2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.023546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a27cc-8b44-406d-831e-50f69d356cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.023748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a27cc-8b44-406d-831e-50f69d356cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.025311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.025930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.026127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.026397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.027830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.031230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.055349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9a5a27cc-8b44-406d-831e-50f69d356cf2 None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:48.056512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 869/1727] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:48.056927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9a5a27cc-8b44-406d-831e-50f69d356cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.057464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.060823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.100647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55424f-895c-4bc5-8cad-bd40fbe09f47 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.112886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b312d1b-0a9c-47b7-b3d6-22c853dd540f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.113503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b312d1b-0a9c-47b7-b3d6-22c853dd540f admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.113773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b312d1b-0a9c-47b7-b3d6-22c853dd540f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.117374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b312d1b-0a9c-47b7-b3d6-22c853dd540f admin admin] PATH_INFO: `/v3/projects/a2d1407cea4b4847b3ae67164282df6d/users/f3da03c57da34542b0654cada85c9426/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.184447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b312d1b-0a9c-47b7-b3d6-22c853dd540f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d1407cea4b4847b3ae67164282df6d, user_id=f3da03c57da34542b0654cada85c9426, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.191628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b312d1b-0a9c-47b7-b3d6-22c853dd540f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.247258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 870/1728] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:48 2022] PUT /identity/v3/projects/a2d1407cea4b4847b3ae67164282df6d/users/f3da03c57da34542b0654cada85c9426/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:48.248910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.249497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.249782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.258017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 859/1729] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:48.259816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.260151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.260838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.327306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] MFA Rules not processed for user `8fd40d2528354adcad63e59310cbfad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:48.331271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.340094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] MFA Rules not processed for user `3d8766c7feb842df9990df32a340903a`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:48.343359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.495987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 860/1730] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:48.495987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.507183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 871/1731] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:48.513805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.656710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.665473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e18f0-dcb9-4f80-a5ff-737ff71bfe3d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.671914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fec3ed-ecc8-49f7-9f82-d80f46f9042b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.672652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec3ed-ecc8-49f7-9f82-d80f46f9042b admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.672929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec3ed-ecc8-49f7-9f82-d80f46f9042b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.674027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fec3ed-ecc8-49f7-9f82-d80f46f9042b admin admin] PATH_INFO: `/v3/projects/4cc933c74054438b98a5d7fcee911fd1/users/cc05210b0c78430bab7310491d5afecb/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.682086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc777-c416-41b1-9425-7ece03e9f9f2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:48.696368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fec3ed-ecc8-49f7-9f82-d80f46f9042b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cc933c74054438b98a5d7fcee911fd1, user_id=cc05210b0c78430bab7310491d5afecb, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.698967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:48.700311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.700636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.700818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fec3ed-ecc8-49f7-9f82-d80f46f9042b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.700928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.701563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:48.701867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:48.704819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:48.728324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 872/1732] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:48 2022] PUT /identity/v3/projects/4cc933c74054438b98a5d7fcee911fd1/users/cc05210b0c78430bab7310491d5afecb/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:48.730349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:48.730644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:48.730917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:48.740928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:48.757167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 861/1733] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:48.758168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.762320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.814869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] MFA Rules not processed for user `f3da03c57da34542b0654cada85c9426`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:48.816375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.938345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 873/1734] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:48.939832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:48.941416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:48.986797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86281d-fb5c-494b-8969-1be5dc4d1d06 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.048421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879acd40-1a31-4441-ae4c-8ceaeaa373c8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.055150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.055801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.056199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.056671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] PATH_INFO: `/v3/projects/ded86f6a4704437ab3f2b2e9cf8e0a6c` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.060092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded86f6a4704437ab3f2b2e9cf8e0a6c)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.062255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.137082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded86f6a4704437ab3f2b2e9cf8e0a6c', 'request_id': 'req-b713fe25-0d07-4439-a2e8-8ca852e0f94d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:49.153274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded86f6a4704437ab3f2b2e9cf8e0a6c', 'request_id': 'req-b713fe25-0d07-4439-a2e8-8ca852e0f94d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:49.164781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e852996-c5ab-46d9-b6c9-da24a5362e81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.165685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852996-c5ab-46d9-b6c9-da24a5362e81 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.165868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852996-c5ab-46d9-b6c9-da24a5362e81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.166017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e852996-c5ab-46d9-b6c9-da24a5362e81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.171356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded86f6a4704437ab3f2b2e9cf8e0a6c', 'request_id': 'req-b713fe25-0d07-4439-a2e8-8ca852e0f94d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:49.187466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] The token cache is being invalidate because project ded86f6a4704437ab3f2b2e9cf8e0a6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:16:49.188197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:49.189732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:16:49.195703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 874/1735] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:16:48 2022] DELETE /identity/v3/projects/ded86f6a4704437ab3f2b2e9cf8e0a6c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:49.197801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.201189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.217727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e852996-c5ab-46d9-b6c9-da24a5362e81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.227497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e852996-c5ab-46d9-b6c9-da24a5362e81 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.240736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.254094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 862/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:49.255434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.255719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.256025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.304248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713fe25-0d07-4439-a2e8-8ca852e0f94d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.310921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.311700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.312137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.312495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.313262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.316682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.337143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] MFA Rules not processed for user `cc05210b0c78430bab7310491d5afecb`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:49.338708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.374552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 875/1737] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.376051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.379438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.489860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815c24d5-3b36-4be3-a442-6c916e69de80 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.495346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0030311d-d3f9-4c54-be99-f5a069aeb061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.496308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030311d-d3f9-4c54-be99-f5a069aeb061 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.496636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030311d-d3f9-4c54-be99-f5a069aeb061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.497007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0030311d-d3f9-4c54-be99-f5a069aeb061 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.497747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030311d-d3f9-4c54-be99-f5a069aeb061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.498410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 863/1738] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:49.499329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.500123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0030311d-d3f9-4c54-be99-f5a069aeb061 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.500743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.526530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e578b-e926-4855-bda2-448cf8fd1cba None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.535476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.536142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.536428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.536790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.537450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.539708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 876/1739] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/projects => generated 403 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.540542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.541581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.542336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.542903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.571916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:49.575312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.580319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 864/1740] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.581550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.600598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.680453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 877/1741] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:49.680453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.685118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.694980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b4f90-75fa-4bc5-8d9d-f53dcb29a52a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.709673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.711196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.711196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.711196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.711473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.714366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.730520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a0628-42c8-4380-8213-d9e44b04bdee None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.742399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.743671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.744189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.744687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.746664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.751051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.758309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 865/1742] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.762906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.783432 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3438b4-1048-48c2-8ee4-51c349d78ba9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:49.806763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a3327-49ce-4c67-9645-f4ecd17f4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:49.807670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a3327-49ce-4c67-9645-f4ecd17f4955 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.808868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a3327-49ce-4c67-9645-f4ecd17f4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.810365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a3327-49ce-4c67-9645-f4ecd17f4955 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.811038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a3327-49ce-4c67-9645-f4ecd17f4955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:49.814597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a3327-49ce-4c67-9645-f4ecd17f4955 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:49.829619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 878/1743] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/projects => generated 401 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.830609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:49.860835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:49.890413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 866/1744] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/users => generated 302 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:49.892428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:49.892807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:49.893463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:49.959112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:49.962016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:49.998338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546af25-c2a2-468f-a596-bf41b14310b9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.007327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.008015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.008353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.008695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.010631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.028067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.105739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 879/1745] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/users => generated 290 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:50.105739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.144413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620835c3-d470-44a7-b7b0-d98135944e60 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.159396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.160285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.160566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.160885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.161559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.163330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.176175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 880/1746] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:50.176872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.188869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51fb06-6cdc-43df-8577-5adf4d0a1218 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.194422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.195064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.195631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.195919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.196767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.215656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.272380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 867/1747] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:50.277805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.279606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 881/1748] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:50 2022] POST /identity/v3/users => generated 307 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:50.280735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.304251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1fab7-bb1a-4777-a896-f778f91ad44c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.322314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.323248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.324262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.324975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.325952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.326598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0999da-9682-4939-bd46-8559e0c4f1f1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.328872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.358283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 868/1749] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:50.358283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.359132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.360005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.360487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.360939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.361950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.367313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.374629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5d99a6-3fd0-4984-a770-f3c4a442fd46 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.385863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.386710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.387097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.387477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] PATH_INFO: `/v3/projects/56a725160f2345f89e45395a3197f612/users/0d7a16c35b604b09aa04142f612403a1/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.393129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 882/1750] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:50.393129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.402380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35b3b2-5b10-4fd6-8e18-c098b7986157 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.407524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.408194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.408474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.408743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.409406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:16:50.414991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.420210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.425890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a725160f2345f89e45395a3197f612, user_id=0d7a16c35b604b09aa04142f612403a1, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.431097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.449164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 883/1751] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:16:50.450268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.464776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 869/1752] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:50 2022] PUT /identity/v3/projects/56a725160f2345f89e45395a3197f612/users/0d7a16c35b604b09aa04142f612403a1/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:50.467089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.489995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393bf70-a134-43a0-b10a-245f3091421d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.648673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:50.671362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.674388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.674842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.675244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.676101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.677921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.691795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 884/1753] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:50.692789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.705278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fa512-d579-4592-8426-77f083225a3a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.708883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30df1be0-fd88-40c5-98d8-cdf95ebc4624 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.726866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.728149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.728440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.728709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.729371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.731535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.757271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.760332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 870/1754] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:50.761263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.763420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.763784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.764093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] PATH_INFO: `/v3/projects/0326e542887349ac8fb567228d946591/users/b14d74db95044229906e8c70205bd20a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.803086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5ce87-cbd6-4e22-b406-7c08a3f42661 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.819666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.820725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.821104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:50.821480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:50.822231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.828079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0326e542887349ac8fb567228d946591, user_id=b14d74db95044229906e8c70205bd20a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:50.830977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.862817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 885/1755] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:50 2022] PUT /identity/v3/projects/0326e542887349ac8fb567228d946591/users/b14d74db95044229906e8c70205bd20a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:50.863862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.871732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:50.920525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:50.966088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477f7e-f6fe-4b7b-8c47-45569375244d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:50.988614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 871/1756] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:50 2022] POST /identity/v3/projects => generated 409 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:50.989969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:50.994680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:50.995374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:50.995655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.005118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.011419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.014722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.042675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 886/1757] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:51.044230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.070536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fe776-7d82-40da-b9a2-74a01bfa210b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.245852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb3b2c-5021-4a80-b380-a18538a8db4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.246767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3b2c-5021-4a80-b380-a18538a8db4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.247358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3b2c-5021-4a80-b380-a18538a8db4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.247787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3b2c-5021-4a80-b380-a18538a8db4f admin admin] PATH_INFO: `/v3/projects/5047e5cf637b490a8ebf006113a10df0/users/db32924948ce474dbaa4c7b4fe8e281e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.253944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74db5df-281a-454d-b196-4e8a76f937d8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.268844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.269742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.270188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.270705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] PATH_INFO: `/v3/projects/6a161befb1004ccdb287e00d13fef77e/users/beb6208866824fd390532f9385b5368d/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.290125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a161befb1004ccdb287e00d13fef77e, user_id=beb6208866824fd390532f9385b5368d, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.291221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb3b2c-5021-4a80-b380-a18538a8db4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5047e5cf637b490a8ebf006113a10df0, user_id=db32924948ce474dbaa4c7b4fe8e281e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.293718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.301153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb3b2c-5021-4a80-b380-a18538a8db4f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.312812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 872/1758] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:50 2022] PUT /identity/v3/projects/6a161befb1004ccdb287e00d13fef77e/users/beb6208866824fd390532f9385b5368d/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:51.316826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.343224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 887/1759] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:51 2022] PUT /identity/v3/projects/5047e5cf637b490a8ebf006113a10df0/users/db32924948ce474dbaa4c7b4fe8e281e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:51.349254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.350988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.351437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.393689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] MFA Rules not processed for user `d452a433fe3d45018e247cc9424cafbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:51.396553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:51.433801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d09ccb-d257-4762-b2be-4f2bd153194b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.517906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.532488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.533371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.533752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.534127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.535191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.537367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.554277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 888/1760] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:51.555184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.559698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 873/1761] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:51.566265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.589652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19a182-262a-4d8d-9ea5-4c5fd0277ab9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.595427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767acb2-76da-4308-9bc6-bc83b6849898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.596196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767acb2-76da-4308-9bc6-bc83b6849898 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.597434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767acb2-76da-4308-9bc6-bc83b6849898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.597821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767acb2-76da-4308-9bc6-bc83b6849898 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.598566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767acb2-76da-4308-9bc6-bc83b6849898 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.600172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b335c5-76b1-47ec-b7f6-3409d5df615c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.601163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767acb2-76da-4308-9bc6-bc83b6849898 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.617119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.619537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.619935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.622704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] PATH_INFO: `/v3/projects/56a725160f2345f89e45395a3197f612/users/0d7a16c35b604b09aa04142f612403a1/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.629755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a725160f2345f89e45395a3197f612, user_id=0d7a16c35b604b09aa04142f612403a1, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.633740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.653553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 889/1762] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:51 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:51.654852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.656927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.659476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.674419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 874/1763] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:51 2022] PUT /identity/v3/projects/56a725160f2345f89e45395a3197f612/users/0d7a16c35b604b09aa04142f612403a1/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:51.674419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.805766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:51.829611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:51.832278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:51.853068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bee45-40ac-4703-848c-920f7ce723e0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.859607 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436abe8b-ded2-4e73-8867-5a9ccbe7fcbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.860358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436abe8b-ded2-4e73-8867-5a9ccbe7fcbe admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.860669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436abe8b-ded2-4e73-8867-5a9ccbe7fcbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.860962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436abe8b-ded2-4e73-8867-5a9ccbe7fcbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.862027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436abe8b-ded2-4e73-8867-5a9ccbe7fcbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.863732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436abe8b-ded2-4e73-8867-5a9ccbe7fcbe admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:51.880273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 875/1764] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:51.881892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.882381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.882660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.907764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:51.909612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:51.926262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 876/1765] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:51.927493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:51.962090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8b19-c0b6-4dea-b050-2eac79c6e014 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:51.976218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291ae11-d1a8-4346-a0de-ca27ca087d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:51.977570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ae11-d1a8-4346-a0de-ca27ca087d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:51.979567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ae11-d1a8-4346-a0de-ca27ca087d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:51.980953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291ae11-d1a8-4346-a0de-ca27ca087d91 admin admin] PATH_INFO: `/v3/projects/0326e542887349ac8fb567228d946591/users/b14d74db95044229906e8c70205bd20a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:51.987022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ae11-d1a8-4346-a0de-ca27ca087d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0326e542887349ac8fb567228d946591, user_id=b14d74db95044229906e8c70205bd20a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:51.996254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291ae11-d1a8-4346-a0de-ca27ca087d91 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.022041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 890/1766] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:16:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:52.030007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 877/1767] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:51 2022] PUT /identity/v3/projects/0326e542887349ac8fb567228d946591/users/b14d74db95044229906e8c70205bd20a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:52.033148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.033452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.033729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.052050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.079576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c0ef8-9bae-4913-8c21-4f0a201ce24b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.151156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.152313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.153313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.153313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.153996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.156091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] MFA Rules not processed for user `0d7a16c35b604b09aa04142f612403a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:52.156745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.161471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.179461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 891/1768] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:52.179461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.190672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a999cd57-5cf0-40f3-a0a0-72392fb0c3a4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.196455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffdaf1-6e96-4376-9cf5-972bc9bdd4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.197400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffdaf1-6e96-4376-9cf5-972bc9bdd4e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.197810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffdaf1-6e96-4376-9cf5-972bc9bdd4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.198162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffdaf1-6e96-4376-9cf5-972bc9bdd4e1 admin admin] PATH_INFO: `/v3/projects/6a161befb1004ccdb287e00d13fef77e/users/beb6208866824fd390532f9385b5368d/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.201772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffdaf1-6e96-4376-9cf5-972bc9bdd4e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a161befb1004ccdb287e00d13fef77e, user_id=beb6208866824fd390532f9385b5368d, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.205840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ffdaf1-6e96-4376-9cf5-972bc9bdd4e1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.250050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 892/1769] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:52 2022] PUT /identity/v3/projects/6a161befb1004ccdb287e00d13fef77e/users/beb6208866824fd390532f9385b5368d/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:52.251570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.251856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.258199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.331359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] MFA Rules not processed for user `b14d74db95044229906e8c70205bd20a`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:52.333025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.367402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 878/1770] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:52.369063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.392394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb2332-ffd4-42c1-bff7-acf157f76ecb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.465782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 893/1771] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:52.466797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.468412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.491349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:52.517091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:52.605964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5661f3-74b6-4047-8858-2a7ecadfd43a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.613532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80bb3e-c718-4344-be16-f2d2342deedc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.614173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80bb3e-c718-4344-be16-f2d2342deedc service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.614452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80bb3e-c718-4344-be16-f2d2342deedc service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.614725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80bb3e-c718-4344-be16-f2d2342deedc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.619848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.635910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.636989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.637950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80bb3e-c718-4344-be16-f2d2342deedc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.638443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.639729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80bb3e-c718-4344-be16-f2d2342deedc service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.641736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.645494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.664896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 894/1772] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:52.666477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.666761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.667060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.683714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 879/1773] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:52.684741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.690177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.739459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] MFA Rules not processed for user `beb6208866824fd390532f9385b5368d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:52.740716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.794380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c064796-8ea1-4a2c-8b56-d5ef3fb2c981 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:52.808742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:52.815071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:52.815420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:52.815769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:52.917655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 895/1774] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:52 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:52.918604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:52.926020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:52.950726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:52.953623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:52.998420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 880/1775] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:52.999198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.008239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:53.036609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a4d1-96d1-43d6-8d61-a1f00fec8896 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.057538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.058211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.058485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.058755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.091028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.112596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.155529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 881/1776] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:53.155859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.204402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c554f7-c7eb-4514-94ef-b0f3f715c79f service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.252141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.253249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.253725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.254212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] PATH_INFO: `/v3/projects/a45262daa2824e1cb92f4a2962f99653/users/9e395b5b4c9542ee988a3990867176ef/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.299498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a45262daa2824e1cb92f4a2962f99653, user_id=9e395b5b4c9542ee988a3990867176ef, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.302244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.317743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507138-4271-4e53-89bc-0986ea2c5d27 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.330433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 882/1777] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:53 2022] PUT /identity/v3/projects/a45262daa2824e1cb92f4a2962f99653/users/9e395b5b4c9542ee988a3990867176ef/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:53.330433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.409008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:53.410175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:53.437015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832e90f-5ee4-4840-a2a8-d939ec91217a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.454274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ce7e1-7285-44ff-b45c-7009572c0878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.455039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce7e1-7285-44ff-b45c-7009572c0878 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.455689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce7e1-7285-44ff-b45c-7009572c0878 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.455689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce7e1-7285-44ff-b45c-7009572c0878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.575782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.576453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.576984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.577429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.694235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce7e1-7285-44ff-b45c-7009572c0878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.697323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce7e1-7285-44ff-b45c-7009572c0878 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.743575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 883/1778] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:53.746755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.747049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.747328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.796014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:53.797600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:53.828536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 896/1779] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:16:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 910 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:16:53.829696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:53.840974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1a391-d79f-4cc0-8c72-4d433ef847bd service swift] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:53.848083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:53.848913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:53.849533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:53.849955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:53.885264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:53.893089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] MFA Rules not processed for user `9e395b5b4c9542ee988a3990867176ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:53.899751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:54.224479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 884/1780] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:53 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:54.232334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:54.255140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566ce20-9a1f-49d7-b286-1939861be1e3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:54.275697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:54.278679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.278975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.279257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.280078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:54.289204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:54.289897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:54.362862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 897/1781] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:54.372550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:54.583793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:54.592682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5fcb0-7525-495a-8ee0-eb2713260da0 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:54.635032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a8570-e056-4527-a806-0b98177c2cc4 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:54.655530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 885/1782] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:54.670066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:54.670612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.670902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.674893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.675811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:54.688711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:54.730654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:54.775650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:54.776129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:54.776691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:54.831668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 898/1783] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:54 2022] POST /identity/v3/projects => generated 407 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:54.832995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:54.839629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:54.840999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:54.925842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:55.054248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babae78-f64b-461c-9497-6b6f6f741436 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.063404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.064572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.065006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.069519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.072950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.076292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.102502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 886/1784] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 31 12:16:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:55.155158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.159858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 899/1785] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:54 2022] POST /identity/v3/users => generated 310 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:55.181249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c03dd6-b4d5-492b-9a59-a86c13c0d53c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.196595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.212693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.213411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.215919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.217930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.220338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.259134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.259561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 887/1786] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:16:55.280568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c511e9dc-d5d1-471b-8c2f-5673ffd35db4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.300081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.301007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.301235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.301539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] PATH_INFO: `/v3/projects/f63d12b737f045f3a33f8f0a446675c5/users/6a87aaaadf1d4bccb40a93ac4cb6c128/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.353320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63d12b737f045f3a33f8f0a446675c5, user_id=6a87aaaadf1d4bccb40a93ac4cb6c128, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.356635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.377873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.408275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 900/1787] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:55 2022] PUT /identity/v3/projects/f63d12b737f045f3a33f8f0a446675c5/users/6a87aaaadf1d4bccb40a93ac4cb6c128/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:55.413115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.603602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c40c081-6b23-4700-a6ae-c0588630ad9f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.616267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.616932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.617375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.617745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.618492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.621936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.644682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 901/1788] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:55.646094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:55.648674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:55.751208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3528460-5d05-4a7f-90d8-d1a80758f0a8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.810194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:55.868015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c459a-8231-41fd-8e25-dc29b81e775a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:55.883813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.884502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.884785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.885062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.910367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:55.913522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:55.925356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b257c0-f678-4023-b947-214e00c8767e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:55.935465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b257c0-f678-4023-b947-214e00c8767e service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:55.935785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b257c0-f678-4023-b947-214e00c8767e service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:55.936109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b257c0-f678-4023-b947-214e00c8767e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:55.956244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 902/1789] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:55.964465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.031459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ba988-47b4-418c-b301-ca3fdfc8df9c service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.051181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d43107-0fed-4bd7-a7c0-b0d4a06a47dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.052313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d43107-0fed-4bd7-a7c0-b0d4a06a47dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.054386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d43107-0fed-4bd7-a7c0-b0d4a06a47dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.055493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d43107-0fed-4bd7-a7c0-b0d4a06a47dc admin admin] PATH_INFO: `/v3/projects/f63d12b737f045f3a33f8f0a446675c5/users/6a87aaaadf1d4bccb40a93ac4cb6c128/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.067993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d43107-0fed-4bd7-a7c0-b0d4a06a47dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63d12b737f045f3a33f8f0a446675c5, user_id=6a87aaaadf1d4bccb40a93ac4cb6c128, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.077225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d43107-0fed-4bd7-a7c0-b0d4a06a47dc admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.107020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 903/1790] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:55 2022] PUT /identity/v3/projects/f63d12b737f045f3a33f8f0a446675c5/users/6a87aaaadf1d4bccb40a93ac4cb6c128/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:56.108712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.109187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.109444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.142876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] MFA Rules not processed for user `db32924948ce474dbaa4c7b4fe8e281e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:56.144153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:56.145928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b257c0-f678-4023-b947-214e00c8767e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.148515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b257c0-f678-4023-b947-214e00c8767e service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.175003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 888/1791] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:55 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 798 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:56.177006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.179508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.181211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.232195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 904/1792] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:56.235626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.262349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] MFA Rules not processed for user `6a87aaaadf1d4bccb40a93ac4cb6c128`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:16:56.264324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:16:56.325957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29620f5-57ca-4db8-83db-d4aa29db2a22 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.329615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:56.341932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.342548 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.342832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.343108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.343903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.345896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.428596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 905/1793] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:16:56 2022] POST /identity/v3/projects => generated 403 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:56.428596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.456502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 889/1794] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:16:56 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:16:56.501886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.540909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:56.573632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166a9f8f-0d73-4bf2-b406-e559d5684280 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.589105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.589750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.590091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.590354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.591075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.593143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.648894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 906/1795] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:16:56 2022] POST /identity/v3/users => generated 308 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:16:56.649940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.679981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1ee8c-15d8-496b-ab41-99b93a8e9cca admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.695754 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.699006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.699291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.699818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.700517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.706673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0528ca-af94-4374-a38c-11440ca92435 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.707545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.737219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 907/1796] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:16:56.738278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.759204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ac83f-ccea-4563-bcf9-1899ad83c959 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:56.774302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.774980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:56.775257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:56.775528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] PATH_INFO: `/v3/projects/d70fd92fe7e44652975ef8e3ddad72ca/users/ac1ee6b02cf24306b92b1c1f23df56fc/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:56.838569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70fd92fe7e44652975ef8e3ddad72ca, user_id=ac1ee6b02cf24306b92b1c1f23df56fc, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:56.841696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:56.872606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 908/1797] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:56 2022] PUT /identity/v3/projects/d70fd92fe7e44652975ef8e3ddad72ca/users/ac1ee6b02cf24306b92b1c1f23df56fc/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:56.873641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:56.993993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:56.998261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.000390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.000551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.162945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a53c0-76f1-4169-9ce2-ca6a875a7bdf admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.190919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.192419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.193109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.194830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.197060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.202455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.245779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 909/1798] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/roles => generated 1420 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:16:57.249259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:57.285476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.289022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf20bb-d981-4f65-aedb-c2cc8b8cd4d8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:57.290524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.305017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a422bc8-4252-4cc5-afd0-d528f7f1c580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:57.306055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422bc8-4252-4cc5-afd0-d528f7f1c580 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:57.321746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422bc8-4252-4cc5-afd0-d528f7f1c580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:57.321746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a422bc8-4252-4cc5-afd0-d528f7f1c580 admin admin] PATH_INFO: `/v3/projects/d70fd92fe7e44652975ef8e3ddad72ca/users/ac1ee6b02cf24306b92b1c1f23df56fc/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:57.326418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422bc8-4252-4cc5-afd0-d528f7f1c580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70fd92fe7e44652975ef8e3ddad72ca, user_id=ac1ee6b02cf24306b92b1c1f23df56fc, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:57.335502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a422bc8-4252-4cc5-afd0-d528f7f1c580 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:57.348550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 890/1799] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:56 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 847 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:16:57.371335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 910/1800] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:16:57 2022] PUT /identity/v3/projects/d70fd92fe7e44652975ef8e3ddad72ca/users/ac1ee6b02cf24306b92b1c1f23df56fc/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:16:57.993671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:16:58.002871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26721c8f-6168-48fe-8c5e-6a010a7ecb5b service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:16:58.061153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:16:58.196086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77874a1f-5aca-416b-8ea8-18bca9bec6d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:16:58.197010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874a1f-5aca-416b-8ea8-18bca9bec6d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:16:58.197436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874a1f-5aca-416b-8ea8-18bca9bec6d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:16:58.197848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77874a1f-5aca-416b-8ea8-18bca9bec6d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:16:58.438802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77874a1f-5aca-416b-8ea8-18bca9bec6d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:16:58.440773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77874a1f-5aca-416b-8ea8-18bca9bec6d0 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:16:58.474406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 891/1801] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:16:57 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:00.625584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54c777-483d-40ef-be70-b60aa868713c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.626646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54c777-483d-40ef-be70-b60aa868713c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.627281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd54c777-483d-40ef-be70-b60aa868713c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.629900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 911/1802] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:17:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:00.691414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:00.692593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:00.693255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:00.731340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:00.733484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:01.000510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 892/1803] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:17:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:01.406775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54c777-483d-40ef-be70-b60aa868713c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.409066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fd54c777-483d-40ef-be70-b60aa868713c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:01.451316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd54c777-483d-40ef-be70-b60aa868713c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.470325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535249ab-969c-4b78-ad3f-c3180611ad0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.471328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535249ab-969c-4b78-ad3f-c3180611ad0e service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.471815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535249ab-969c-4b78-ad3f-c3180611ad0e service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.472339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535249ab-969c-4b78-ad3f-c3180611ad0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.510107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535249ab-969c-4b78-ad3f-c3180611ad0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.514093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535249ab-969c-4b78-ad3f-c3180611ad0e service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.529700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:01.549872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 912/1804] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:01.731140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5b3f3-6400-48f5-8bc2-ba2a90301d96 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:01.752098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:01.755386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:01.755673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:01.755981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] PATH_INFO: `/v3/users/f3da03c57da34542b0654cada85c9426` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:01.758724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3da03c57da34542b0654cada85c9426)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:01.761805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:01.790999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:01.882241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3da03c57da34542b0654cada85c9426'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:01.908998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3da03c57da34542b0654cada85c9426'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:01.909915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3da03c57da34542b0654cada85c9426'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:01.960983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3da03c57da34542b0654cada85c9426'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:01.963561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-edba4e15-b152-4156-896c-a3eadaf44b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3da03c57da34542b0654cada85c9426'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:02.045519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 893/1805] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:01 2022] DELETE /identity/v3/users/f3da03c57da34542b0654cada85c9426 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:02.050236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.050768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.050857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.127144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:02.137926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:02.316671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.316833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.317172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.419875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] MFA Rules not processed for user `ac1ee6b02cf24306b92b1c1f23df56fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:02.424163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:02.430337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 913/1806] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:02.439298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:02.443034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:02.515866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:02.635049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 894/1807] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:02.677019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78407a87-a09f-43ff-bd00-13d0ea453fc6 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:02.699636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b12a58-1386-488f-8ea7-ec8cb83d6e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:02.704304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b12a58-1386-488f-8ea7-ec8cb83d6e6b service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:02.704606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b12a58-1386-488f-8ea7-ec8cb83d6e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:02.704883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b12a58-1386-488f-8ea7-ec8cb83d6e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:02.754689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b12a58-1386-488f-8ea7-ec8cb83d6e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:02.767218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b12a58-1386-488f-8ea7-ec8cb83d6e6b service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:02.828519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 914/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:03.610401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:03.613781 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:03.644728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e6489-dc56-44cf-aad7-4394c254b7e8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:03.660587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:03.661417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:03.661734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:03.662017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] PATH_INFO: `/v3/users/cc05210b0c78430bab7310491d5afecb` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:03.667157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc05210b0c78430bab7310491d5afecb)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:03.669198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:03.777019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc05210b0c78430bab7310491d5afecb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:03.802675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc05210b0c78430bab7310491d5afecb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:03.803536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc05210b0c78430bab7310491d5afecb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:03.845083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:03.847633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc05210b0c78430bab7310491d5afecb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:03.848963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc05210b0c78430bab7310491d5afecb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:03.911622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 895/1809] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:03 2022] DELETE /identity/v3/users/cc05210b0c78430bab7310491d5afecb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:03.916622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:03.917534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:03.917941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:03.970999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:03.973560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:04.020514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:04.023050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:04.174823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c299e-34a0-498a-8f3e-e1f4d1279044 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:04.180599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 915/1810] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:04.188279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:04.188943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:04.189224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:04.189494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] PATH_INFO: `/v3/projects/a2d1407cea4b4847b3ae67164282df6d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:04.190676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d1407cea4b4847b3ae67164282df6d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:04.193340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:04.203297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:04.205173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:04.353001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d6649-dd85-46d1-8d60-036e44899b04 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:04.372880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d1407cea4b4847b3ae67164282df6d', 'request_id': 'req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.389659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d1407cea4b4847b3ae67164282df6d', 'request_id': 'req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.403088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d1407cea4b4847b3ae67164282df6d', 'request_id': 'req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.420237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] The token cache is being invalidate because project a2d1407cea4b4847b3ae67164282df6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:04.420616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.421598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.427026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 896/1811] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:04 2022] DELETE /identity/v3/projects/a2d1407cea4b4847b3ae67164282df6d => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:04.431090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:04.437410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:04.481618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:04.482256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:04.482534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:04.482879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:04.487662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:04.562594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:04.605494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c0eac-0d91-4d19-9b28-12b5c03fcda5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:04.619940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:04.620628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:04.621081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:04.621563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] PATH_INFO: `/v3/users/b14d74db95044229906e8c70205bd20a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:04.623107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14d74db95044229906e8c70205bd20a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:04.630722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:04.663656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:04.665361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08970690-a0c4-4796-a149-97fefd40eea2 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:04.677627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:04.778078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 916/1812] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:04.784626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14d74db95044229906e8c70205bd20a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.837364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14d74db95044229906e8c70205bd20a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.838513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14d74db95044229906e8c70205bd20a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.921280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14d74db95044229906e8c70205bd20a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.922152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a79c1bbd-1a61-4d12-bea5-12febc086976 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14d74db95044229906e8c70205bd20a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:04.952322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 897/1813] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:04 2022] DELETE /identity/v3/users/b14d74db95044229906e8c70205bd20a => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:05.687885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6038b-dbee-41ec-97de-9c890ece5df9 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.688415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6038b-dbee-41ec-97de-9c890ece5df9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.688540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6038b-dbee-41ec-97de-9c890ece5df9 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.693485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 917/1814] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:17:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:05.708411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b9eb-91af-42a8-a313-696a00255276 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.708994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b9eb-91af-42a8-a313-696a00255276 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.709145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de11b9eb-91af-42a8-a313-696a00255276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.762620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-de11b9eb-91af-42a8-a313-696a00255276 None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:05.767610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-de11b9eb-91af-42a8-a313-696a00255276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:05.863401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 898/1815] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:05.944197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcb28-2523-47c9-a5c5-605f5fe501b1 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.945453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcb28-2523-47c9-a5c5-605f5fe501b1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.946029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcb28-2523-47c9-a5c5-605f5fe501b1 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:05.948842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 918/1816] 10.222.0.48 () {54 vars in 961 bytes} [Wed Aug 31 12:17:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:05.959487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:05.959972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:05.960765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.006323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:06.008773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:06.021671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 899/1817] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Aug 31 12:17:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:06.045046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcb28-2523-47c9-a5c5-605f5fe501b1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.074903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcb28-2523-47c9-a5c5-605f5fe501b1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.095025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.095779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.096160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.096470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.128202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.129386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.163419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 919/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:06.396592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.398475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:06.544212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6163ec-101c-4563-be6c-936dd5fcbeeb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.559576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.560275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.560557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.560827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] PATH_INFO: `/v3/users/9e395b5b4c9542ee988a3990867176ef` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.564234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e395b5b4c9542ee988a3990867176ef)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.566362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.647323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:06.684072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:06.685489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:06.692912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e395b5b4c9542ee988a3990867176ef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.717139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e395b5b4c9542ee988a3990867176ef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.720281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e395b5b4c9542ee988a3990867176ef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.723661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b843cdf-45a8-444b-bf5f-310100a8bdad service placement] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:06.734360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:06.735277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.735700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.736356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] PATH_INFO: `/v3/projects/4cc933c74054438b98a5d7fcee911fd1` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.740753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cc933c74054438b98a5d7fcee911fd1)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:06.744744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:06.760966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e395b5b4c9542ee988a3990867176ef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.762356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a91dcf4b-cbdc-41e7-a417-6d13e9657810 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e395b5b4c9542ee988a3990867176ef'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.789951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 900/1819] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:06 2022] DELETE /identity/v3/users/9e395b5b4c9542ee988a3990867176ef => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:06.815099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:06.818796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:06.818796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:06.895336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:06.896785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cc933c74054438b98a5d7fcee911fd1', 'request_id': 'req-d60ee427-6b70-43a7-8042-d9eeaa3677b1'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.898813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:06.950613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cc933c74054438b98a5d7fcee911fd1', 'request_id': 'req-d60ee427-6b70-43a7-8042-d9eeaa3677b1'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:06.984428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cc933c74054438b98a5d7fcee911fd1', 'request_id': 'req-d60ee427-6b70-43a7-8042-d9eeaa3677b1'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.007384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] The token cache is being invalidate because project 4cc933c74054438b98a5d7fcee911fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:07.007681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.012219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.014510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 920/1820] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:06 2022] DELETE /identity/v3/projects/4cc933c74054438b98a5d7fcee911fd1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:07.018648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.022262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:07.126318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 901/1821] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:07.145564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.147711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:07.166860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ee427-6b70-43a7-8042-d9eeaa3677b1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.173050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.173792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.174076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.174417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] PATH_INFO: `/v3/users/beb6208866824fd390532f9385b5368d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.176096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=beb6208866824fd390532f9385b5368d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.178883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.233115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:07.252023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0165f30c-6261-4476-afd6-ef3b389b3319 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.254493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'beb6208866824fd390532f9385b5368d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.258039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.258837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.259013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.259406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.265965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'beb6208866824fd390532f9385b5368d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.267444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'beb6208866824fd390532f9385b5368d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.270359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'beb6208866824fd390532f9385b5368d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.271928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.274507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.287684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 902/1822] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:07.293509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b8a70c0-f750-4d8c-b913-4cc50c753d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'beb6208866824fd390532f9385b5368d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.313183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 921/1823] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:07 2022] DELETE /identity/v3/users/beb6208866824fd390532f9385b5368d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:07.589796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:07.592163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:07.619865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa50b1-a448-42b2-addb-3463ee2a6760 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:07.705627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:07.724515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:07.725236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.725586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.725931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] PATH_INFO: `/v3/projects/0326e542887349ac8fb567228d946591` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.727306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0326e542887349ac8fb567228d946591)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:07.730542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:07.801955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0326e542887349ac8fb567228d946591', 'request_id': 'req-627788f3-7cbc-40c6-9eb6-4ece98469ab6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.808796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0326e542887349ac8fb567228d946591', 'request_id': 'req-627788f3-7cbc-40c6-9eb6-4ece98469ab6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.816913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0326e542887349ac8fb567228d946591', 'request_id': 'req-627788f3-7cbc-40c6-9eb6-4ece98469ab6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.835523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] The token cache is being invalidate because project 0326e542887349ac8fb567228d946591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:07.835877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.836789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-627788f3-7cbc-40c6-9eb6-4ece98469ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:07.843283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 903/1824] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:07 2022] DELETE /identity/v3/projects/0326e542887349ac8fb567228d946591 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:07.845902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562449-784d-48d3-9555-e4d8912c6a7a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.849175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562449-784d-48d3-9555-e4d8912c6a7a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.849175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562449-784d-48d3-9555-e4d8912c6a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.878226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-36562449-784d-48d3-9555-e4d8912c6a7a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:07.879535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-36562449-784d-48d3-9555-e4d8912c6a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:07.886430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ac8b0-b2a9-4696-8e31-09f6f1abb0d7 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.886733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ac8b0-b2a9-4696-8e31-09f6f1abb0d7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.886992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ac8b0-b2a9-4696-8e31-09f6f1abb0d7 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.889244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 904/1825] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:17:07.915332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.915804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.916128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:07.942081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] MFA Rules not processed for user `952511916961431fb58ba2e07e24f4f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:07.943641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:07.976393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 922/1826] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:07.983993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:07.984583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:07.985016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.008420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:08.010009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.026987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 923/1827] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:08.041035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.046081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.079559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 905/1828] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:17:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:08.081401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.085353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051bb0a-7125-4bf3-bba4-d06af026c24c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.106983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a08c3f-215a-4fa8-95b1-8011cd786a23 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.113340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.114776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.115395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.115842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.116704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:08.117236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.117577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.118471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.119414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.120393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.120756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] PATH_INFO: `/v3/users/db32924948ce474dbaa4c7b4fe8e281e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.124365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=db32924948ce474dbaa4c7b4fe8e281e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.128638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.138898 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 906/1829] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:08.152010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.154064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.177907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b7216-e4b7-46d3-8418-27ebb9bf09d5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.193078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.193078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.193666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.194249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] PATH_INFO: `/v3/projects/a45262daa2824e1cb92f4a2962f99653` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.196515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a45262daa2824e1cb92f4a2962f99653)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.201338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.209155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db32924948ce474dbaa4c7b4fe8e281e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.237349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db32924948ce474dbaa4c7b4fe8e281e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.238136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db32924948ce474dbaa4c7b4fe8e281e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.238888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db32924948ce474dbaa4c7b4fe8e281e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.266426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db32924948ce474dbaa4c7b4fe8e281e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.275164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a45262daa2824e1cb92f4a2962f99653', 'request_id': 'req-ae7971c3-849c-4f45-901c-49ad1187c432'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.285750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.289341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a45262daa2824e1cb92f4a2962f99653', 'request_id': 'req-ae7971c3-849c-4f45-901c-49ad1187c432'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.298044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 924/1830] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:08 2022] DELETE /identity/v3/users/db32924948ce474dbaa4c7b4fe8e281e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:08.299111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.300954 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a45262daa2824e1cb92f4a2962f99653', 'request_id': 'req-ae7971c3-849c-4f45-901c-49ad1187c432'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.301421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.329481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] The token cache is being invalidate because project a45262daa2824e1cb92f4a2962f99653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:08.329853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.330514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.335642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.335916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 907/1831] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:08 2022] DELETE /identity/v3/projects/a45262daa2824e1cb92f4a2962f99653 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:08.336918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.341070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.404964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305ba7a-6669-40da-a972-b32abfbd33cf admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.412772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.412772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.412772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.413186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] PATH_INFO: `/v3/projects/6a161befb1004ccdb287e00d13fef77e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.414152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a161befb1004ccdb287e00d13fef77e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.416160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.455033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7971c3-849c-4f45-901c-49ad1187c432 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.493962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a161befb1004ccdb287e00d13fef77e', 'request_id': 'req-7ff844fd-1601-4632-8b7a-abc9e81f9794'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.514416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a161befb1004ccdb287e00d13fef77e', 'request_id': 'req-7ff844fd-1601-4632-8b7a-abc9e81f9794'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.524907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a161befb1004ccdb287e00d13fef77e', 'request_id': 'req-7ff844fd-1601-4632-8b7a-abc9e81f9794'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.539464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] The token cache is being invalidate because project 6a161befb1004ccdb287e00d13fef77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:08.539978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.540937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.542793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 925/1832] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:08 2022] DELETE /identity/v3/projects/6a161befb1004ccdb287e00d13fef77e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:08.543641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.544907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.562281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.563498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.563782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.564397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.566418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.580136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.581765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.592768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 908/1833] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:08.593485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.594946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.609543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c466380-6519-43de-b2b8-5eddb716ad4b service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.615028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.615660 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.615982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.616502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff844fd-1601-4632-8b7a-abc9e81f9794 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.616623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] PATH_INFO: `/v3/users/6a87aaaadf1d4bccb40a93ac4cb6c128` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.617479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a87aaaadf1d4bccb40a93ac4cb6c128)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.619479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.621212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.621837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.622115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.622384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.623028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.624990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.658900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 926/1834] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:08 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:08.659847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.663524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.684360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a87aaaadf1d4bccb40a93ac4cb6c128'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.694924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a87aaaadf1d4bccb40a93ac4cb6c128'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.695619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a87aaaadf1d4bccb40a93ac4cb6c128'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.709083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.710019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a87aaaadf1d4bccb40a93ac4cb6c128'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.710677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-28491a28-cce5-40ca-aaf7-7607af1913ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a87aaaadf1d4bccb40a93ac4cb6c128'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.711874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:08.733145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 909/1835] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:08 2022] DELETE /identity/v3/users/6a87aaaadf1d4bccb40a93ac4cb6c128 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:08.733145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.733145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.733145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.740374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e984594-b71e-4e05-956e-3543d3b66562 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.754372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:08.756463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.837804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 910/1836] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:08.837804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.837804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.838176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.839148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.839559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.839925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] PATH_INFO: `/v3/projects/5047e5cf637b490a8ebf006113a10df0` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.841515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5047e5cf637b490a8ebf006113a10df0)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.844475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.848663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2469f36-c3bc-466e-a6e2-c5dd2870b9a8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:08.864985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe73e6-81a8-4295-85de-74dcf0897ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:08.867306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe73e6-81a8-4295-85de-74dcf0897ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.867639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe73e6-81a8-4295-85de-74dcf0897ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.867918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe73e6-81a8-4295-85de-74dcf0897ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.868593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe73e6-81a8-4295-85de-74dcf0897ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:08.874982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe73e6-81a8-4295-85de-74dcf0897ee3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:08.917993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5047e5cf637b490a8ebf006113a10df0', 'request_id': 'req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.928619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5047e5cf637b490a8ebf006113a10df0', 'request_id': 'req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.936074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 911/1837] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:08 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:08.936074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:08.936074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:08.936074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:08.942728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5047e5cf637b490a8ebf006113a10df0', 'request_id': 'req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.967476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:08.968723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:08.977302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] The token cache is being invalidate because project 5047e5cf637b490a8ebf006113a10df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:08.978050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.979825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:08.982440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 927/1838] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:08 2022] DELETE /identity/v3/projects/5047e5cf637b490a8ebf006113a10df0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:08.983535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:08.985138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.058670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 912/1839] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:09.058670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.058950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.072466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719439f-4397-43d1-a7cd-2fd10f3a6f73 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.078887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.079597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.079797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.080102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] PATH_INFO: `/v3/users/ac1ee6b02cf24306b92b1c1f23df56fc` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.081890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1ee6b02cf24306b92b1c1f23df56fc)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.083470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd0a63-feb7-4f9d-a57a-b1cfd4551937 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.083842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.089508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.090821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.091309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.092055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.093202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.096572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.114480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 928/1840] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:09.116660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.136006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784cbe4-ac54-4669-8cdf-f7a0508e8778 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.143531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.144546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.145330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.145613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.146293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:09.146601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.149161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.152246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.176474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1ee6b02cf24306b92b1c1f23df56fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.181237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1ee6b02cf24306b92b1c1f23df56fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.182156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1ee6b02cf24306b92b1c1f23df56fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.183106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 929/1841] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:09.184724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.194340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.195714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b869ad9-9300-44b8-899b-1a1e39c8b5dd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.197505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1ee6b02cf24306b92b1c1f23df56fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.199097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1ee6b02cf24306b92b1c1f23df56fc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.202594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.203369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.203592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.203871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.204563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.206423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.219520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 930/1842] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:09.220515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.221995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 913/1843] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:09 2022] DELETE /identity/v3/users/ac1ee6b02cf24306b92b1c1f23df56fc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:09.224892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.225072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.227723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.244608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c481ad-2051-4472-b4dc-1b6cda8289d4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.312925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc9eee-336e-4233-b564-2326ff74cb2b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.319513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4441fc-2ddc-4bec-a131-f44b15deeb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.320224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4441fc-2ddc-4bec-a131-f44b15deeb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.320503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4441fc-2ddc-4bec-a131-f44b15deeb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.320776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4441fc-2ddc-4bec-a131-f44b15deeb2a admin admin] PATH_INFO: `/v3/projects/45c7f28e53e4467d8cb6ae5e7901f6cf/users/e7d97533d5dd4f5ea4726f7cfdc803d2/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.323927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.324825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.325110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.325387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.326072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.328218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.339968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4441fc-2ddc-4bec-a131-f44b15deeb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=45c7f28e53e4467d8cb6ae5e7901f6cf, user_id=e7d97533d5dd4f5ea4726f7cfdc803d2, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.342966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4441fc-2ddc-4bec-a131-f44b15deeb2a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.361072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 931/1844] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:09.361413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 914/1845] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:09 2022] PUT /identity/v3/projects/45c7f28e53e4467d8cb6ae5e7901f6cf/users/e7d97533d5dd4f5ea4726f7cfdc803d2/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:09.369207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.372115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.372257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.373688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.411114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] MFA Rules not processed for user `e7d97533d5dd4f5ea4726f7cfdc803d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:09.411886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.486787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fe974-3ab1-4095-bd01-202504df3b3a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.492163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.492999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.493319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.493599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.495654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.498072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.535339 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 915/1846] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:09.538768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 932/1847] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:09.538912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.538912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.539584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.568476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cbc5a1-d1bc-4f5f-a63f-8d58b89704b7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.573927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6d13c-4bfb-4e1f-b805-54bf903c2964 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.579368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.579923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.580186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.580456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] PATH_INFO: `/v3/projects/f63d12b737f045f3a33f8f0a446675c5` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.581614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63d12b737f045f3a33f8f0a446675c5)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.583501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.594189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.594809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.595365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.595494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.596158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.602754 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.637180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 933/1848] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:09.638055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.646098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63d12b737f045f3a33f8f0a446675c5', 'request_id': 'req-20347abe-eb30-4388-aafe-6dc67fa37beb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.649720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.667494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63d12b737f045f3a33f8f0a446675c5', 'request_id': 'req-20347abe-eb30-4388-aafe-6dc67fa37beb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.676606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63d12b737f045f3a33f8f0a446675c5', 'request_id': 'req-20347abe-eb30-4388-aafe-6dc67fa37beb'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.686033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:09.699284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] The token cache is being invalidate because project f63d12b737f045f3a33f8f0a446675c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:09.700038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.700812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.703379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 916/1849] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:09 2022] DELETE /identity/v3/projects/f63d12b737f045f3a33f8f0a446675c5 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:09.704167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.705609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.711149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c2e0a5-4236-4ca8-b1f7-74d5c2b417de admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.720547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.721179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.721462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.721736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.722395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.724031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.742279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 934/1850] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:09.743294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.745893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.758884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c03d01-c1e2-4194-9f81-3f532d10642a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.764289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ce562-700e-4d9d-8b78-5bf4d4386ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.764897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce562-700e-4d9d-8b78-5bf4d4386ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.765174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce562-700e-4d9d-8b78-5bf4d4386ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.765444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ce562-700e-4d9d-8b78-5bf4d4386ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.766348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ce562-700e-4d9d-8b78-5bf4d4386ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.768186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ce562-700e-4d9d-8b78-5bf4d4386ea6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.799006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 935/1851] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/users => generated 296 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:09.799006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.799006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.799006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.822391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20347abe-eb30-4388-aafe-6dc67fa37beb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.825312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:09.827934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.836287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.836287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.836287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.836287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] PATH_INFO: `/v3/projects/d70fd92fe7e44652975ef8e3ddad72ca` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.836695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70fd92fe7e44652975ef8e3ddad72ca)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.841554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.849996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 936/1852] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:09.849996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.849996 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.873084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e5ed5-5542-4a2e-8cbb-c7c5c1d555bf None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.883241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.884218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.884715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.885146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.886907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.890003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:09.902899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 937/1853] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:09.903673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:09.914408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70fd92fe7e44652975ef8e3ddad72ca', 'request_id': 'req-9c0a4740-af49-408a-9099-0743fe589fe6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.917179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562c250-ea95-4d0d-bfeb-387a7bc1a14f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:09.923561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70fd92fe7e44652975ef8e3ddad72ca', 'request_id': 'req-9c0a4740-af49-408a-9099-0743fe589fe6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.930976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70fd92fe7e44652975ef8e3ddad72ca', 'request_id': 'req-9c0a4740-af49-408a-9099-0743fe589fe6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.947027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] The token cache is being invalidate because project d70fd92fe7e44652975ef8e3ddad72ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:09.947318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.948524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9c0a4740-af49-408a-9099-0743fe589fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:09.950389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 917/1854] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:09 2022] DELETE /identity/v3/projects/d70fd92fe7e44652975ef8e3ddad72ca => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:09.951662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9d9c-fbf6-4519-9e27-6fb5e640de6f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.951964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9d9c-fbf6-4519-9e27-6fb5e640de6f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.952243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85c9d9c-fbf6-4519-9e27-6fb5e640de6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.978380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c85c9d9c-fbf6-4519-9e27-6fb5e640de6f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:09.979650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c85c9d9c-fbf6-4519-9e27-6fb5e640de6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:09.986438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:09.987084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:09.987388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:09.987859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:09.988545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:09.990212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.000992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 938/1855] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:10.001813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.003596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.017522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3d496-f592-4195-9138-e97318401f5e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.022464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.023135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.023415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.023692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] PATH_INFO: `/v3/projects/a59234be05f04382a01515c57450d099/users/ec723f7a45d74a1888dc78659775b094/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.039492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59234be05f04382a01515c57450d099, user_id=ec723f7a45d74a1888dc78659775b094, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.042858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.044526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 918/1856] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:10.046075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.046210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.046382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.056692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 939/1857] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:10 2022] PUT /identity/v3/projects/a59234be05f04382a01515c57450d099/users/ec723f7a45d74a1888dc78659775b094/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:10.064918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.066677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.067134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:10.068355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.074129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:10.148879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309eb130-7e3b-4d7e-98a5-84680063a4d7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.154186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 919/1858] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:10.154913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8281921-8000-4154-af75-1fb42da4bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.155585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281921-8000-4154-af75-1fb42da4bfef admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.155867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281921-8000-4154-af75-1fb42da4bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.156178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8281921-8000-4154-af75-1fb42da4bfef admin admin] PATH_INFO: `/v3/projects/5b47acfb9b5c4700b228bc35595385f7/users/33fd6d5529d6497fb8284d283217ea78/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.161437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.171468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de3362-44f1-4f39-bb10-7091a32cb659 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.174606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8281921-8000-4154-af75-1fb42da4bfef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b47acfb9b5c4700b228bc35595385f7, user_id=33fd6d5529d6497fb8284d283217ea78, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.176842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.177064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8281921-8000-4154-af75-1fb42da4bfef admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.177597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.178063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.178397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.179115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:10.179486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.179595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:10.181403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155efbe8-3058-40d4-846b-e7d6941cddb6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.197478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 920/1859] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:10.199790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.200123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.200400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.201732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 940/1860] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:10 2022] PUT /identity/v3/projects/5b47acfb9b5c4700b228bc35595385f7/users/33fd6d5529d6497fb8284d283217ea78/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:10.203309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.204027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.204904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.233632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:10.235457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.236614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] MFA Rules not processed for user `ec723f7a45d74a1888dc78659775b094`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:10.238338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.310508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 941/1861] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:10.311390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 921/1862] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:10.315446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.315594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.322416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fdd846-bd21-498b-8078-08da87408bd2 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.328438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74428d-270d-4127-9b40-43b7ffc14b47 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.328636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.329395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.329807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.330015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.330658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.332316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.334027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.334737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.335082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.335470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.336226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.338245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.345908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 942/1863] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:10.350402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.363064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a107e-6caf-4463-846b-5c0d6387640e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.368828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.369586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.370215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 922/1864] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.370307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.370544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.371115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.371226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:10.371472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.373112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.387213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 943/1865] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:10.388158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.400409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31617f-b569-42a8-b04d-d16d6072fdc1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.452953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827c85f6-815c-4e02-bd3e-cffbe87d2892 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.457811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.458502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.458788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.459063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.459704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.465142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.482157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.482931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.484840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:10.484980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.484980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] PATH_INFO: `/v3/projects/5b47acfb9b5c4700b228bc35595385f7/users/33fd6d5529d6497fb8284d283217ea78/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.486393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b47acfb9b5c4700b228bc35595385f7, user_id=33fd6d5529d6497fb8284d283217ea78, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.489419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.502848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 944/1866] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:10 2022] PUT /identity/v3/projects/5b47acfb9b5c4700b228bc35595385f7/users/33fd6d5529d6497fb8284d283217ea78/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:10.503715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.510046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 923/1867] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.510046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.582682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210bf82-dc07-4418-b869-31c8405ae5e8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.589580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.591067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.591067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.591067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.591552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.593554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.595390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c41eb-1fde-4d1c-8726-2dd9fbe62517 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.600891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd05511-f2a8-456d-ae70-0b8f1c7872b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.601527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05511-f2a8-456d-ae70-0b8f1c7872b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.601812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05511-f2a8-456d-ae70-0b8f1c7872b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.602090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd05511-f2a8-456d-ae70-0b8f1c7872b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.603550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd05511-f2a8-456d-ae70-0b8f1c7872b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.606180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd05511-f2a8-456d-ae70-0b8f1c7872b4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.609023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:10.627039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 945/1868] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/users => generated 283 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.627989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.641966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a1c4f-f674-46bb-bf9b-7d7d3d695517 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.647606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.648478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.648864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.649144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.649795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.655397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 924/1869] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/projects => generated 363 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.655606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.655762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.655762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.655762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.678391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 946/1870] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/users => generated 297 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.679446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.686229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] MFA Rules not processed for user `33fd6d5529d6497fb8284d283217ea78`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:10.688136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.694490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058996a-eeff-45dd-927e-cf73e3ce2e17 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.777330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 925/1871] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:10.778265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.780481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.781096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.781378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.781707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.782531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.784200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.795132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2cbe8-d368-4df2-b599-5c43722bd114 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.798662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 947/1872] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:10.798662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.803668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.804437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.804771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.805036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.805674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.808318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.808536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f0355-b992-4491-b4bb-20edc158eb54 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.813558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.814186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.814545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.814720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.815375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.817050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.833458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 948/1873] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:10.833458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.833458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:10.837719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 926/1874] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:10 2022] POST /identity/v3/users => generated 282 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:10.845077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.855098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797dce97-7da3-4837-94cb-05da420c054f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.859923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.860566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.860846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.861118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.861784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.863416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.874713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 927/1875] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:10.875616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.888977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7920ba6f-d4a4-4432-a7b3-5a2f67c07cea admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.895274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.895990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.896254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.896529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] PATH_INFO: `/v3/projects/af96a0a2826f49fcb41ba797c4eab258/users/c78002325ca14557b4d600c51a96e3c3/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.909448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a32995e-1b63-427e-b40b-814f1ab29379 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:10.913506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:10.913858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af96a0a2826f49fcb41ba797c4eab258, user_id=c78002325ca14557b4d600c51a96e3c3, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.914264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:10.914620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:10.914991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:10.920192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.930420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:10.931388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:10.938758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 928/1876] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:10 2022] PUT /identity/v3/projects/af96a0a2826f49fcb41ba797c4eab258/users/c78002325ca14557b4d600c51a96e3c3/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:10.938758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.944131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 949/1877] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:10.945792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:10.948882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:10.966304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5ec4e-26bc-4e5a-a7d8-dff11e97a971 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.034578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34080cb0-0852-45b4-9f44-d3e43fe38c2f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.040490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.041236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.041546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.042346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.044419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.048221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.056309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.056992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.057307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.057587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] PATH_INFO: `/v3/projects/221739efe1014b34aed2bcf64a3dc5ee/users/e9efcc556bc84cd38827b2415f90a4bc/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.068022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 929/1878] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:10 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:11.068022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.068319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:11.080788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=221739efe1014b34aed2bcf64a3dc5ee, user_id=e9efcc556bc84cd38827b2415f90a4bc, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.084104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.089238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23962a2-89b7-4913-ba85-30d06a23aa1e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.094956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53dd110-f358-4600-a7b6-d0048bc0f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.095599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dd110-f358-4600-a7b6-d0048bc0f1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.095879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dd110-f358-4600-a7b6-d0048bc0f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.096203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dd110-f358-4600-a7b6-d0048bc0f1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.096870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dd110-f358-4600-a7b6-d0048bc0f1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.098469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53dd110-f358-4600-a7b6-d0048bc0f1f7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.104544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 950/1879] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:10 2022] PUT /identity/v3/projects/221739efe1014b34aed2bcf64a3dc5ee/users/e9efcc556bc84cd38827b2415f90a4bc/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:11.105509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.121416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 930/1880] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:11.126063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8510-01a3-42e7-a0c8-dc54418f71a1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.126864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8510-01a3-42e7-a0c8-dc54418f71a1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.126864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a8510-01a3-42e7-a0c8-dc54418f71a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.168695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-990a8510-01a3-42e7-a0c8-dc54418f71a1 None None] MFA Rules not processed for user `e9efcc556bc84cd38827b2415f90a4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:11.172302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-990a8510-01a3-42e7-a0c8-dc54418f71a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:11.204208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b12cd6-2c68-4205-a28a-71cfc194bf78 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.211652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.213244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.213244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.213512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.214114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.216450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.231024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 951/1881] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:11.231990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.243741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55d986-ba91-4185-b544-0c89ab9aca0a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.255378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.256516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.256516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.256789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] PATH_INFO: `/v3/projects/af96a0a2826f49fcb41ba797c4eab258/users/c78002325ca14557b4d600c51a96e3c3/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.259979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af96a0a2826f49fcb41ba797c4eab258, user_id=c78002325ca14557b4d600c51a96e3c3, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.263171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.281976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 952/1882] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:11 2022] PUT /identity/v3/projects/af96a0a2826f49fcb41ba797c4eab258/users/c78002325ca14557b4d600c51a96e3c3/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:11.285886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.305218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 931/1883] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:11.306688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.307014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.307285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.354797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] MFA Rules not processed for user `c78002325ca14557b4d600c51a96e3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:11.356349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:11.404605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77fcea3-7c40-436f-a13e-9d839d067579 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.428213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.430097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.432905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.433334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] PATH_INFO: `/v3/projects/4b0c92473c7b41d19e7f5a1a42a752a8/users/a68f7683664442ddb7acb14d938ea6ac/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.460506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b0c92473c7b41d19e7f5a1a42a752a8, user_id=a68f7683664442ddb7acb14d938ea6ac, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.464729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.471347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 932/1884] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:11.472625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.488205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55d8f-b1ed-4bb8-885f-d4cd880bc3d8 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.491804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 953/1885] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:11 2022] PUT /identity/v3/projects/4b0c92473c7b41d19e7f5a1a42a752a8/users/a68f7683664442ddb7acb14d938ea6ac/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:11.494003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:11.496912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.563753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2a32a-4a96-4c46-9680-15b7d9a465fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.564532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:11.565537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2a32a-4a96-4c46-9680-15b7d9a465fa admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.566237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2a32a-4a96-4c46-9680-15b7d9a465fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.566779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2a32a-4a96-4c46-9680-15b7d9a465fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.567659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2a32a-4a96-4c46-9680-15b7d9a465fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.569746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2a32a-4a96-4c46-9680-15b7d9a465fa admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.580010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6f1560-cf80-4d57-a563-ad2914cf083e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.584680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fd6d5529d6497fb8284d283217ea78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47acfb9b5c4700b228bc35595385f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.585447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.586138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.586138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.586659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:11.586965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.588755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.608047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 954/1886] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:11.608047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.612080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 933/1887] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:11.612596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.613528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.613528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.650368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] MFA Rules not processed for user `a68f7683664442ddb7acb14d938ea6ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:11.652306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:11.695484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c731c64-f90f-468b-abb3-f4cace099639 tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.735581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 934/1888] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:11.736681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.767034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.767795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.768133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.768405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.826373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba143e8-2e21-48d2-ab3c-65b5e73ba680 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.831511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fd6d5529d6497fb8284d283217ea78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47acfb9b5c4700b228bc35595385f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.832193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.832379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.832659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.833393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.835226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.844696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.846943 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:11.858795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 955/1889] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:11.859837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.866610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 935/1890] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/projects => generated 354 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:11.867789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:11.905063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:11.928738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:11.948381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23232d3-37cd-4596-95fb-53aa3537b998 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.986219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8584af-98f6-4e60-9097-d5471f18e29f tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:11.992223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:11.992855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:11.993137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:11.993697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:11.994184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:11.996744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.032274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 936/1891] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/projects => generated 363 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:12.032274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.041484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.042854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.043430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.044460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.045401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.047712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.072515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 956/1892] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:11 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:12.074739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.125075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14298af4-3cde-4a51-be07-2d5ef2345cfc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.130463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fd6d5529d6497fb8284d283217ea78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47acfb9b5c4700b228bc35595385f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.131099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.131490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.131884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.132678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:12.133087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.135100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.149684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 937/1893] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:12.150622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.150968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174fe56f-a64f-4482-a960-42b848014ed5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.222697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.223316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.223597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.223867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.250091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e8f5cf-b4b6-4cad-8911-7758d74c527e tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.255018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.255635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.255917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.256226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.256865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.258802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.283796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 938/1894] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:12 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:12.283796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.287907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.289471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.291375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47f73-b841-4297-92fd-7f3ae74c5d89 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.294782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:12.298634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.299377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.299726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.300094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.300607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 957/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:12.301402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.302836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.304783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.316836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b5fe-7172-4f48-a625-9e5d18bee1f0 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.318025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 939/1896] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:12.319379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.325912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fd6d5529d6497fb8284d283217ea78', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b47acfb9b5c4700b228bc35595385f7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.326702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.327074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.327448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] PATH_INFO: `/v3/projects/ff90b15cd1214d28b2f8e16006313374` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.329253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff90b15cd1214d28b2f8e16006313374)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.331286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.341479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21264ff1-19f4-48d9-9740-20e4e28cd381 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.355515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.361494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.361494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.361494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.361494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.364164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.365940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:12.383576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 940/1897] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:12.384709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.398563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e352a0-a49d-4180-a572-fceda1d06e15 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.404394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.405269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.405558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.405842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] PATH_INFO: `/v3/projects/33c3391df3c64b8a875b0b0828244050/users/f885c099472b47c8bc32ea8db2dfe556/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.428832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c3391df3c64b8a875b0b0828244050, user_id=f885c099472b47c8bc32ea8db2dfe556, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.432489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.473362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 941/1898] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:12 2022] PUT /identity/v3/projects/33c3391df3c64b8a875b0b0828244050/users/f885c099472b47c8bc32ea8db2dfe556/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:12.474231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.491446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff90b15cd1214d28b2f8e16006313374', 'request_id': 'req-5d6d9a9b-cc02-4357-a44d-759e408228ea'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:12.505086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff90b15cd1214d28b2f8e16006313374', 'request_id': 'req-5d6d9a9b-cc02-4357-a44d-759e408228ea'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:12.516860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff90b15cd1214d28b2f8e16006313374', 'request_id': 'req-5d6d9a9b-cc02-4357-a44d-759e408228ea'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:12.535462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] The token cache is being invalidate because project ff90b15cd1214d28b2f8e16006313374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:12.536220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:12.536939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:12.539035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 958/1899] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:12 2022] DELETE /identity/v3/projects/ff90b15cd1214d28b2f8e16006313374 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:12.539846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.541335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:12.570966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb8452-495a-4f61-aefe-bfde2ab757f3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.634446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d9a9b-cc02-4357-a44d-759e408228ea tempest-VolumeQuotaClassesTest-686951852 tempest-VolumeQuotaClassesTest-686951852-project-admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.640662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.641513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.641897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.642733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.643561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.646064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.663231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 959/1900] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:12.664442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.672474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.673198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.673580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.673850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] PATH_INFO: `/v3/projects/828eb7dbc56e483fae83b19183c2fa75/users/ba84598e2e2c43be8eea35d5ff42305f/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.681431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05ddf8-ef1d-4eca-8ea7-47b1228c062b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.693039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fd9c84-8599-453d-84b9-2e9eba789a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.693758 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9c84-8599-453d-84b9-2e9eba789a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.694038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9c84-8599-453d-84b9-2e9eba789a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.694317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fd9c84-8599-453d-84b9-2e9eba789a12 admin admin] PATH_INFO: `/v3/projects/33c3391df3c64b8a875b0b0828244050/users/f885c099472b47c8bc32ea8db2dfe556/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.697653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9c84-8599-453d-84b9-2e9eba789a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33c3391df3c64b8a875b0b0828244050, user_id=f885c099472b47c8bc32ea8db2dfe556, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.702145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fd9c84-8599-453d-84b9-2e9eba789a12 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.726255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 960/1901] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:12 2022] PUT /identity/v3/projects/33c3391df3c64b8a875b0b0828244050/users/f885c099472b47c8bc32ea8db2dfe556/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:12.727847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.728255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.728388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.748878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=828eb7dbc56e483fae83b19183c2fa75, user_id=ba84598e2e2c43be8eea35d5ff42305f, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.753643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.786488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 942/1902] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:12 2022] PUT /identity/v3/projects/828eb7dbc56e483fae83b19183c2fa75/users/ba84598e2e2c43be8eea35d5ff42305f/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:12.789919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:12.793143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:12.834590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] MFA Rules not processed for user `f885c099472b47c8bc32ea8db2dfe556`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:12.836406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:12.975867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33952e-f013-41bc-be57-f2e996159cbe admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:12.986020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:12.987259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:12.987799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:12.988539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:12.989344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:12.992196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:12.994588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:12.995690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.014839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 943/1903] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:13.016109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.018546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.024553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 961/1904] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:12 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:13.025370 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.037282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bafbfb-e56a-49e4-9078-cfb3f5b23150 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.045346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.046045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.046380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.046664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] PATH_INFO: `/v3/users/e7d97533d5dd4f5ea4726f7cfdc803d2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.049785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d97533d5dd4f5ea4726f7cfdc803d2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.051980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2824b4c3-28d1-4c52-8aa8-388905a8c4b2 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.054887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.062100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.064510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.065485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.065485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] PATH_INFO: `/v3/projects/828eb7dbc56e483fae83b19183c2fa75/users/ba84598e2e2c43be8eea35d5ff42305f/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.069886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=828eb7dbc56e483fae83b19183c2fa75, user_id=ba84598e2e2c43be8eea35d5ff42305f, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.075450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.090354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 962/1905] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:13 2022] PUT /identity/v3/projects/828eb7dbc56e483fae83b19183c2fa75/users/ba84598e2e2c43be8eea35d5ff42305f/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:13.091450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.093491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.135969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d97533d5dd4f5ea4726f7cfdc803d2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:13.148570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d97533d5dd4f5ea4726f7cfdc803d2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:13.150133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d97533d5dd4f5ea4726f7cfdc803d2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:13.167829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d97533d5dd4f5ea4726f7cfdc803d2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:13.168656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-1eaf82cc-029f-4195-8b06-154b8915f234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d97533d5dd4f5ea4726f7cfdc803d2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:13.170147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4aced7-b11f-4777-8d7c-47add6e68bf8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.177465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.178225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.178512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.178783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.180970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.193622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 944/1906] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:13 2022] DELETE /identity/v3/users/e7d97533d5dd4f5ea4726f7cfdc803d2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:13.196335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.197279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.197687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.253380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] MFA Rules not processed for user `ba84598e2e2c43be8eea35d5ff42305f`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:13.255592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.340306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.341995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe7c2f-7e35-46bb-bbfe-f575c6afbeec service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.352890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 963/1907] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:13.354587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.355040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.355352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.377744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 945/1908] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:13.386761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:13.388029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.389750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.394717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.479473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f623763-a514-4215-8f4f-c5f0e85722e6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.482012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 964/1909] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:13.483253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.483858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.484167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.484436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.484853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.489425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.494494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.496634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.500650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.503013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f9249d-8ab2-4a8e-bced-4c1b85ad3507 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.506980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.507608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.507891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.508190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.509353 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 946/1910] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:13.509994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.510563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.512598 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.542104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:13.584899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db43067d-3db7-4251-a5aa-8538873333b2 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.586523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.587979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.593293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.593910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.594319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.594735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.597946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 965/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:13.598803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.606258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.607194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149e01e-88c5-4d99-a6f1-f2d670aa2dc1 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.607990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.611992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.612625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.613061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.613449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.615204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.619579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 947/1912] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:13.691371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:13.693107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:13.704335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 966/1913] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:13.964500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:13.967155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:13.987611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c5930-0453-4131-a9ff-eaacae410344 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:13.993762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:13.994426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:13.995721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:13.995721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] PATH_INFO: `/v3/projects/45c7f28e53e4467d8cb6ae5e7901f6cf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:13.999041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45c7f28e53e4467d8cb6ae5e7901f6cf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.001499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.069029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45c7f28e53e4467d8cb6ae5e7901f6cf', 'request_id': 'req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.076338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45c7f28e53e4467d8cb6ae5e7901f6cf', 'request_id': 'req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.086013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45c7f28e53e4467d8cb6ae5e7901f6cf', 'request_id': 'req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.140740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] The token cache is being invalidate because project 45c7f28e53e4467d8cb6ae5e7901f6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:14.141201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.142472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.159569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 948/1914] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:13 2022] DELETE /identity/v3/projects/45c7f28e53e4467d8cb6ae5e7901f6cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:14.163892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:14.179135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc28e8-5563-48d1-9fb3-67b4c5cb0635 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:14.250838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:14.250838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:14.250838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:14.250838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] PATH_INFO: `/v3/users/33fd6d5529d6497fb8284d283217ea78` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:14.252171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fd6d5529d6497fb8284d283217ea78)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:14.254306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:14.330596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fd6d5529d6497fb8284d283217ea78'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.344964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fd6d5529d6497fb8284d283217ea78'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.346740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fd6d5529d6497fb8284d283217ea78'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.348946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fd6d5529d6497fb8284d283217ea78'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.385871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:14.388855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4c2bc77a-e2a4-4682-94b6-7d977bcbf18a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fd6d5529d6497fb8284d283217ea78'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:14.407664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 967/1915] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:14 2022] DELETE /identity/v3/users/33fd6d5529d6497fb8284d283217ea78 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:15.015846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.018130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.087979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f914b4-6d44-49d7-9ad5-fb25f359d0e8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.159047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.159784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.160166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.161125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] PATH_INFO: `/v3/projects/5b47acfb9b5c4700b228bc35595385f7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.162344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b47acfb9b5c4700b228bc35595385f7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.164687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.202796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.227935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b47acfb9b5c4700b228bc35595385f7', 'request_id': 'req-81660216-dc96-4a36-b096-c94b9e5851b8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.234176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b47acfb9b5c4700b228bc35595385f7', 'request_id': 'req-81660216-dc96-4a36-b096-c94b9e5851b8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.240746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b47acfb9b5c4700b228bc35595385f7', 'request_id': 'req-81660216-dc96-4a36-b096-c94b9e5851b8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.255457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] The token cache is being invalidate because project 5b47acfb9b5c4700b228bc35595385f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:15.255891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.256644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-81660216-dc96-4a36-b096-c94b9e5851b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.258155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 949/1916] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:15 2022] DELETE /identity/v3/projects/5b47acfb9b5c4700b228bc35595385f7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:15.264997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.266421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.267280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.288933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:15.290335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.428994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 968/1917] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:15.437234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.437629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.437974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.470484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.470484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.477365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:15.478958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.485454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c5b7a-2e3d-49aa-89c4-399b71abdf60 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.492234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.492796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.493143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.493435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] PATH_INFO: `/v3/users/ec723f7a45d74a1888dc78659775b094` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.495446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec723f7a45d74a1888dc78659775b094)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.497585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.509510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 950/1918] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:15.516277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.528319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b13e08-b2b3-4a26-8605-d52f59f5b080 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.541239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.542259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.542696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.543336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.544205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:15.544552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.546247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.555495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec723f7a45d74a1888dc78659775b094'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.564359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 951/1919] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:15.566688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.569956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec723f7a45d74a1888dc78659775b094'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.570602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec723f7a45d74a1888dc78659775b094'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.571298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec723f7a45d74a1888dc78659775b094'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.582883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c5839-f19f-4c22-b7d9-7f91db235e49 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.590960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-46a4eb76-973e-48b6-b579-3e59fd6de102 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec723f7a45d74a1888dc78659775b094'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:15.595495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.596220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.596714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.597059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.598154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.600953 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.605986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 969/1920] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:15 2022] DELETE /identity/v3/users/ec723f7a45d74a1888dc78659775b094 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:15.613651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.614347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.614971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.657904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:15.676034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 952/1921] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:15.677143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.679796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.683209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.768679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7baa3-0477-4d47-8381-568912c0fc73 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.775016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.776374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.776667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.777094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.778068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.779998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.794022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:15.811192 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 970/1922] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:15.824154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.826682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:15.836045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 953/1923] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:15.838544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.852619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1307-f1ad-4ac1-bd7b-4ce31b7b32e6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.859476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.860720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.861017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.861296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.861981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.863903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.875916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 954/1924] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:15.879974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.890713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c146c29-40b7-456b-8f7f-621055bbe12d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.895854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.896437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.896712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.896982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.897624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.899230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.903143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ef838-72e8-4e12-b363-bbffd3083c7b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.907041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24968a1b-f1ab-4a1f-8edf-e5e259f76e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.907765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24968a1b-f1ab-4a1f-8edf-e5e259f76e00 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.908075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24968a1b-f1ab-4a1f-8edf-e5e259f76e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.908346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24968a1b-f1ab-4a1f-8edf-e5e259f76e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.911563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 955/1925] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:15.915396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:15.919974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24968a1b-f1ab-4a1f-8edf-e5e259f76e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.921423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24968a1b-f1ab-4a1f-8edf-e5e259f76e00 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.927085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eb5004-65d2-402f-98d5-75a3e6302578 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:15.933059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:15.933825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.934730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.934875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 971/1926] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:15.934971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] PATH_INFO: `/v3/projects/20f84a2dac894244a22b0e06e299dd51/users/83473d7e5add4d6ea260038a0504d2f9/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:15.950449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f84a2dac894244a22b0e06e299dd51, user_id=83473d7e5add4d6ea260038a0504d2f9, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:15.953204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:15.969940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 956/1927] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:15 2022] PUT /identity/v3/projects/20f84a2dac894244a22b0e06e299dd51/users/83473d7e5add4d6ea260038a0504d2f9/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:15.979894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:15.980241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:15.980538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.012531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] MFA Rules not processed for user `83473d7e5add4d6ea260038a0504d2f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:16.014059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:16.089357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 972/1928] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:16.093976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.122065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=6,keystone:SELECT=88,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.175485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9765a-9ecf-4213-8366-61f0b22e3bb3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.180285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.180891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.181172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.181484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.183269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.187659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.235867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 957/1929] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:16 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:16.237893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.245118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.247266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:16.256525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f3eca-9f56-4dc2-b07b-adb2a1c8f58f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.333206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d93b25-8786-4932-9cfe-1e443c90d915 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.337948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.339175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.339451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.339720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] PATH_INFO: `/v3/projects/a59234be05f04382a01515c57450d099` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.340369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.340990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59234be05f04382a01515c57450d099)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.341115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.341450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.341785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.342516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.343874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.344621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.372194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 973/1930] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:16 2022] POST /identity/v3/users => generated 294 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:16.374401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.386958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb7c81-b953-4e3e-8e13-eac8e39a61d0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.401521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59234be05f04382a01515c57450d099', 'request_id': 'req-2e3805d1-107c-4ae1-b860-661a450610f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.406246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.407795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59234be05f04382a01515c57450d099', 'request_id': 'req-2e3805d1-107c-4ae1-b860-661a450610f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.417262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59234be05f04382a01515c57450d099', 'request_id': 'req-2e3805d1-107c-4ae1-b860-661a450610f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.432704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] The token cache is being invalidate because project a59234be05f04382a01515c57450d099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:16.432997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.433682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.435214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 958/1931] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:16 2022] DELETE /identity/v3/projects/a59234be05f04382a01515c57450d099 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:16.439429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.442092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:16.480882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.481512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.482067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.482216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.483520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.489982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.506941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 974/1932] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:16.508184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.508594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:16.514156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:16.534378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4942be-1978-4433-bf4d-67c2f006124c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.545175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.545175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.545175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.545175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.545538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.545538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.557845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 975/1933] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:16.562415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.586945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3805d1-107c-4ae1-b860-661a450610f5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.591979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ad9fd-bde3-44cd-9d76-0905ce66680d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:16.597382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4544bcd-66f4-44b7-baf1-d9b1ffd3acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.598189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4544bcd-66f4-44b7-baf1-d9b1ffd3acbd admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.598658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4544bcd-66f4-44b7-baf1-d9b1ffd3acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.599173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4544bcd-66f4-44b7-baf1-d9b1ffd3acbd admin admin] PATH_INFO: `/v3/projects/814a1b14ead944c0bcc91d06a760948a/users/47cf124b36e04dec9dd64720c6c7383d/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.607420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:16.608201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.608644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.608760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] PATH_INFO: `/v3/users/c78002325ca14557b4d600c51a96e3c3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.610121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78002325ca14557b4d600c51a96e3c3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.612332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.635314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4544bcd-66f4-44b7-baf1-d9b1ffd3acbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=814a1b14ead944c0bcc91d06a760948a, user_id=47cf124b36e04dec9dd64720c6c7383d, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:16.643918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4544bcd-66f4-44b7-baf1-d9b1ffd3acbd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:16.669893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 976/1934] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:16 2022] PUT /identity/v3/projects/814a1b14ead944c0bcc91d06a760948a/users/47cf124b36e04dec9dd64720c6c7383d/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:16.678825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78002325ca14557b4d600c51a96e3c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.686008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:16.686417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:16.687184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:16.694987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78002325ca14557b4d600c51a96e3c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.695912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78002325ca14557b4d600c51a96e3c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.724646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78002325ca14557b4d600c51a96e3c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.725965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78002325ca14557b4d600c51a96e3c3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:16.749764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] MFA Rules not processed for user `47cf124b36e04dec9dd64720c6c7383d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:16.753763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:16.790330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 959/1935] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:16 2022] DELETE /identity/v3/users/c78002325ca14557b4d600c51a96e3c3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:16.929955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 977/1936] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:16.935608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:16.936843 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.155524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572dbad-aa16-469c-84a6-8ae18ec503de admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.162791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9d1cc2-a3ae-42ae-a91a-e5b756097ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.163614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1cc2-a3ae-42ae-a91a-e5b756097ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.163981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1cc2-a3ae-42ae-a91a-e5b756097ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.164796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d1cc2-a3ae-42ae-a91a-e5b756097ad2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.165822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d1cc2-a3ae-42ae-a91a-e5b756097ad2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.169062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9d1cc2-a3ae-42ae-a91a-e5b756097ad2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.232695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 960/1937] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:16 2022] POST /identity/v3/projects => generated 385 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:17.234940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.278108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425f21-c0f1-4490-9f34-2372cbe56027 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.278404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425f21-c0f1-4490-9f34-2372cbe56027 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.278702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425f21-c0f1-4490-9f34-2372cbe56027 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.281429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 961/1938] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:17:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:17:17.318372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.319543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.320027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.353129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e3ed4-0a37-45d1-828d-7ac94127e869 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.366318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:17.367604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.375589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:17.455246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.455246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.455246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.455246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.455895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.460310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.517057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 978/1939] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:17 2022] POST /identity/v3/users => generated 299 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:17.518482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.535489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:17.543160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e20a9-c79e-4a6b-a7a8-4e555b0892b1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.555193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.556589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.556874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.557458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.558667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.561571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.589490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 979/1940] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:17.590436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.604655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf1d298-372e-4b5a-aeef-40be61bc3dd5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.611268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.617810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.618000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.618289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] PATH_INFO: `/v3/projects/fea301321bc340c896a2d9712b83748f/users/6d6d1398f9de44f09ce4e3390ea7261c/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.633155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 962/1941] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:17.642563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea301321bc340c896a2d9712b83748f, user_id=6d6d1398f9de44f09ce4e3390ea7261c, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.645625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.661527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.664492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.674884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 980/1942] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:17 2022] PUT /identity/v3/projects/fea301321bc340c896a2d9712b83748f/users/6d6d1398f9de44f09ce4e3390ea7261c/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:17.676694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.685079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f8ef42-ee9c-41d5-b4a1-b2fa1700059a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.787497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be72c8-6aff-4747-b401-e8ec5d561354 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.792476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.793089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.793533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.793921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.794645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.796940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.797857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.798695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.798975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.799736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.809434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 981/1943] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:17.813513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.815417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.816361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.818107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.829872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61df04c7-6ce0-4de1-99ee-b83f7e9419b7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.832218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 963/1944] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:17.835281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.836309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.836600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.836873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] PATH_INFO: `/v3/projects/af96a0a2826f49fcb41ba797c4eab258` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.839209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af96a0a2826f49fcb41ba797c4eab258)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.841460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.845923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:17.861762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39393499-4e29-4fcd-adf7-24db70507aed service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:17.880751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce4c60-500d-4b55-b56f-cb283677b9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:17.882207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4c60-500d-4b55-b56f-cb283677b9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.882698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4c60-500d-4b55-b56f-cb283677b9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.882985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce4c60-500d-4b55-b56f-cb283677b9d7 admin admin] PATH_INFO: `/v3/projects/fea301321bc340c896a2d9712b83748f/users/6d6d1398f9de44f09ce4e3390ea7261c/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.886187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4c60-500d-4b55-b56f-cb283677b9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fea301321bc340c896a2d9712b83748f, user_id=6d6d1398f9de44f09ce4e3390ea7261c, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:17.889654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce4c60-500d-4b55-b56f-cb283677b9d7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:17.909477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 964/1945] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:17 2022] PUT /identity/v3/projects/fea301321bc340c896a2d9712b83748f/users/6d6d1398f9de44f09ce4e3390ea7261c/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:17.917974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af96a0a2826f49fcb41ba797c4eab258', 'request_id': 'req-83a0bd49-1596-422a-a860-9bf42dc55ac0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:17.920590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.920881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.921184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:17.934238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af96a0a2826f49fcb41ba797c4eab258', 'request_id': 'req-83a0bd49-1596-422a-a860-9bf42dc55ac0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:17.944184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af96a0a2826f49fcb41ba797c4eab258', 'request_id': 'req-83a0bd49-1596-422a-a860-9bf42dc55ac0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:17.947558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:17.956733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] MFA Rules not processed for user `6d6d1398f9de44f09ce4e3390ea7261c`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:17.957959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:17.966431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] The token cache is being invalidate because project af96a0a2826f49fcb41ba797c4eab258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:17.966945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:17.969410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-83a0bd49-1596-422a-a860-9bf42dc55ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:17.971103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 982/1946] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:17 2022] DELETE /identity/v3/projects/af96a0a2826f49fcb41ba797c4eab258 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:17.976083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401e43f-64ad-4f6f-9d26-a89755981a7a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:17.976946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401e43f-64ad-4f6f-9d26-a89755981a7a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:17.977382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9401e43f-64ad-4f6f-9d26-a89755981a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.005777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9401e43f-64ad-4f6f-9d26-a89755981a7a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:18.007438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9401e43f-64ad-4f6f-9d26-a89755981a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:18.056040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 965/1947] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:18.070582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.073239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:18.096304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 983/1948] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:18.103641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.104608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.104903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.126189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:18.138224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:18.139857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:18.150030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 984/1949] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:18.153827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.163363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d212ce-bbc9-4940-a720-cb38ccb90b9e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.170039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.170806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.171158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.171507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.172529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:18.172898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.175666 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.183671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3fc831-4ac6-4f3b-9e70-7cd4b787645e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.191731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.192609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.193180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.193605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.206172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.208061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.218236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 985/1950] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:18.223396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.234007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 966/1951] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:18.240331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f47cecf-2a8a-4f71-ad4e-018b341eaa1b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.250989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.251796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.252947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.253403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.254500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.256766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.304108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 986/1952] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:18.305888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.321031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566eac4-134e-4b38-8794-78fce391485a service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.406833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.407597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.407878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.408185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.408853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.410786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.437950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 967/1953] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:18.439467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.450745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db059aa3-0b81-4e45-94a3-4dd2abdfbb24 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.455454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.456099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.456386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.456654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.457300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.459273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.469998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 987/1954] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:18.474491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.488056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933651-0613-4f1c-83c6-edc356f17a2c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.493059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b4f365-8d73-4f1b-bf7e-cf153013079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.494326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4f365-8d73-4f1b-bf7e-cf153013079c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.495183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4f365-8d73-4f1b-bf7e-cf153013079c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.495462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b4f365-8d73-4f1b-bf7e-cf153013079c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.496151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4f365-8d73-4f1b-bf7e-cf153013079c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.498502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b4f365-8d73-4f1b-bf7e-cf153013079c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.510788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 968/1955] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:18.516069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.529228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e507c52-a8f2-4d46-9cda-87a39f3d8f87 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.534692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.536382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.536707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.537371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] PATH_INFO: `/v3/projects/d442b0d59ade49b68285c7d158648961/users/5576ecb6dfc14bc0b61136599278b804/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.555987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d442b0d59ade49b68285c7d158648961, user_id=5576ecb6dfc14bc0b61136599278b804, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.560119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.584045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 988/1956] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:18 2022] PUT /identity/v3/projects/d442b0d59ade49b68285c7d158648961/users/5576ecb6dfc14bc0b61136599278b804/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:18.591184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.591491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.591764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.642590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] MFA Rules not processed for user `5576ecb6dfc14bc0b61136599278b804`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:18.644563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:18.745588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 969/1957] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:18.750377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.856360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86639d54-5e34-4671-a85b-a70a41d29926 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.861886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:18.862730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:18.863087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:18.863374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:18.864112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:18.866131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:18.896136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:18.908940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:18.917224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 989/1958] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:18.921761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5450a0-1bee-4f12-b8e1-95087044030b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:18.966120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.000597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.001224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.001505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.001780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.002419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.004372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.024063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.033296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:19.036055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 970/1959] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:18 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:19.040039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.053208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212a03c-d01b-41ec-a92e-0526c86482b5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.058318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.058994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.059619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.060028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.061211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.062846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.073865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 971/1960] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:19.078620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.090786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc236-b09a-466b-b5d3-f1944c8eac09 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.096876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.097714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.103108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.103557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.104782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.106438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.113560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da6ca6-0321-4d1d-8874-d9c3958cd08d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.117803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 972/1961] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:19.118466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.119093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.119401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.119714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.122836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.123120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:19.134790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18252b32-afc2-4901-9be4-2ed3c6a4e6ce admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.147723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1bc0ad-f7bd-4e0a-8bbb-19f1383be9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.148419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc0ad-f7bd-4e0a-8bbb-19f1383be9da admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.148697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc0ad-f7bd-4e0a-8bbb-19f1383be9da admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.148970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1bc0ad-f7bd-4e0a-8bbb-19f1383be9da admin admin] PATH_INFO: `/v3/projects/2c1d62ee9d1e472bb59abaebe99bccac/users/066e9fc5c30143528d36b20600244750/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.169373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bc0ad-f7bd-4e0a-8bbb-19f1383be9da admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c1d62ee9d1e472bb59abaebe99bccac, user_id=066e9fc5c30143528d36b20600244750, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.172239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1bc0ad-f7bd-4e0a-8bbb-19f1383be9da admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.190177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 973/1962] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:19 2022] PUT /identity/v3/projects/2c1d62ee9d1e472bb59abaebe99bccac/users/066e9fc5c30143528d36b20600244750/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:19.202029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.202648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.202826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.207367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.208983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.228006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 990/1963] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:19.243696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] MFA Rules not processed for user `066e9fc5c30143528d36b20600244750`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:19.246042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:19.376610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 974/1964] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:19.379743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.392617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d1ece-efe2-4676-b9a5-cc284e7fe116 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.530382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.531028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.531307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.531562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.532275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.534361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.570979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 991/1965] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:19 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:19.577437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.596651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c509f-115c-4f3e-ad5d-2f0cb1775361 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.700437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.701921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.702635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.703423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.704943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.707671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.732629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.743124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 975/1966] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:19 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:19.747629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.768600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8796c6b1-5600-4988-aa99-7f6e1e4cae6c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.773653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.774306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.774587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.774887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.775684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.777598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.792079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 992/1967] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:19.796304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.820841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f911d1a-4af3-4977-8b43-dde547719940 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.827268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.828204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.830374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.830762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] PATH_INFO: `/v3/projects/938f2c14929443ecaafb5a7869ff9dcd/users/af418d5dfa884d679431b40be614d0b7/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.839600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.841707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:19.859679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4c8b2-919d-4b3c-94ad-2626c79fb52b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:19.867740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=938f2c14929443ecaafb5a7869ff9dcd, user_id=af418d5dfa884d679431b40be614d0b7, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.870517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.874015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:19.874659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:19.874940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:19.875216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] PATH_INFO: `/v3/users/e9efcc556bc84cd38827b2415f90a4bc` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:19.877189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9efcc556bc84cd38827b2415f90a4bc)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:19.879157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:19.897422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 976/1968] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:19 2022] PUT /identity/v3/projects/938f2c14929443ecaafb5a7869ff9dcd/users/af418d5dfa884d679431b40be614d0b7/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:19.901533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:19.925351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:19.973344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9efcc556bc84cd38827b2415f90a4bc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:19.988998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9efcc556bc84cd38827b2415f90a4bc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:19.990191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9efcc556bc84cd38827b2415f90a4bc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:19.991663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9efcc556bc84cd38827b2415f90a4bc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:20.026057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-3cfa105e-420d-44ca-9315-273203993076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9efcc556bc84cd38827b2415f90a4bc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:20.053566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3e0c66-fd7a-4944-8419-b8b9c5def9b3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.055366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 993/1969] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:19 2022] DELETE /identity/v3/users/e9efcc556bc84cd38827b2415f90a4bc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:20.060339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.060622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.061170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.099739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:20.101851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.146434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.147404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.147885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.148301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.149175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.151137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.165887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 977/1970] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:20.171592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.175497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.219617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e5873-7ceb-4d93-985d-34852b4d9b27 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.226580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9cdec-7d23-4fef-9baf-7ccdf6b2c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.228312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9cdec-7d23-4fef-9baf-7ccdf6b2c94c admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.229418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9cdec-7d23-4fef-9baf-7ccdf6b2c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.230057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9cdec-7d23-4fef-9baf-7ccdf6b2c94c admin admin] PATH_INFO: `/v3/projects/938f2c14929443ecaafb5a7869ff9dcd/users/af418d5dfa884d679431b40be614d0b7/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.233539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9cdec-7d23-4fef-9baf-7ccdf6b2c94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=938f2c14929443ecaafb5a7869ff9dcd, user_id=af418d5dfa884d679431b40be614d0b7, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.238212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 994/1971] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:20.239462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9cdec-7d23-4fef-9baf-7ccdf6b2c94c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.248365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.250095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.254815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 978/1972] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:20 2022] PUT /identity/v3/projects/938f2c14929443ecaafb5a7869ff9dcd/users/af418d5dfa884d679431b40be614d0b7/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:20.265243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.265524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.265788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.316002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] MFA Rules not processed for user `af418d5dfa884d679431b40be614d0b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:20.317867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.393986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278fb11-1bea-4fd8-bf7a-6ef483102c80 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.405567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.440325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 979/1973] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:20.453799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.454854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.455485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.455761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.456052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.457346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.468766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:20.539682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72ecd2-7d90-4c5e-a4b9-0e92796c74cf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.545195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.545829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.546162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.546438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.558790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.559873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.560347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.561580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.574280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 995/1974] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:20.575973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 980/1975] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:20.640965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:20.652153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da66c9-8683-48eb-8e79-9d80d595801d service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:20.657037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:20.657704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:20.658042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:20.658389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:20.660447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:20.831774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:20.833751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:20.846218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 996/1976] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:21.055409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.061941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:21.091110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82de7dd-7543-44e2-b5d2-34864bda509c service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.096400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.097235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.097635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.097990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] PATH_INFO: `/v3/projects/221739efe1014b34aed2bcf64a3dc5ee` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.108000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=221739efe1014b34aed2bcf64a3dc5ee)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.110014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.184848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '221739efe1014b34aed2bcf64a3dc5ee', 'request_id': 'req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.194752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '221739efe1014b34aed2bcf64a3dc5ee', 'request_id': 'req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.209750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '221739efe1014b34aed2bcf64a3dc5ee', 'request_id': 'req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.233976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] The token cache is being invalidate because project 221739efe1014b34aed2bcf64a3dc5ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:21.235013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.235797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.240468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 981/1977] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:21 2022] DELETE /identity/v3/projects/221739efe1014b34aed2bcf64a3dc5ee => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:21.242306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:21.262948 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae59a0-6662-4e23-97e7-599297bac59b service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:21.377095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:21.377879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:21.378340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:21.378691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] PATH_INFO: `/v3/users/f885c099472b47c8bc32ea8db2dfe556` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:21.380272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f885c099472b47c8bc32ea8db2dfe556)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:21.382346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:21.514096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f885c099472b47c8bc32ea8db2dfe556'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.517720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:21.545294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f885c099472b47c8bc32ea8db2dfe556'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.546320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f885c099472b47c8bc32ea8db2dfe556'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.547275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f885c099472b47c8bc32ea8db2dfe556'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.567071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ced1db0d-8d06-47ab-b082-d9e2215a1734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f885c099472b47c8bc32ea8db2dfe556'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:21.617241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 997/1978] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:21 2022] DELETE /identity/v3/users/f885c099472b47c8bc32ea8db2dfe556 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:22.034563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.038193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:22.079688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdfdb6c-d347-4fb7-ae5c-ba86da6da001 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.165124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.165786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.166063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.166379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] PATH_INFO: `/v3/projects/33c3391df3c64b8a875b0b0828244050` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.167494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33c3391df3c64b8a875b0b0828244050)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.169483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.187092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:22.219486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33c3391df3c64b8a875b0b0828244050', 'request_id': 'req-45b0a222-090b-4ea5-b124-4341aca0835a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:22.225189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33c3391df3c64b8a875b0b0828244050', 'request_id': 'req-45b0a222-090b-4ea5-b124-4341aca0835a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:22.237406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33c3391df3c64b8a875b0b0828244050', 'request_id': 'req-45b0a222-090b-4ea5-b124-4341aca0835a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:22.253217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] The token cache is being invalidate because project 33c3391df3c64b8a875b0b0828244050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:22.254038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:22.254724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-45b0a222-090b-4ea5-b124-4341aca0835a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:22.256281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 982/1979] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:22 2022] DELETE /identity/v3/projects/33c3391df3c64b8a875b0b0828244050 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:22.262506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.262786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.263056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.283663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:22.284895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:22.348310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 998/1980] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:22.358090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.358385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.358667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.378708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:22.379924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:22.388776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 983/1981] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:22.392874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.403321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1174363-e3b1-427d-a52a-0b66c7c19a5e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.408003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.408613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.408892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.409164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.409867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:22.410168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.411786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.424573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 999/1982] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:22.429218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.438767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc12345-7825-4bf3-b610-e7c72a48f194 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.443470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.444114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.444428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.444658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.445338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.447275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.479444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 984/1983] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/projects => generated 357 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:22.483684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.493989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea3905-ec52-47ae-b4b4-9756883ba887 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.573209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.573818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.574107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.574379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.575283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.577254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.620028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.626459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1000/1984] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/users => generated 279 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:22.641212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639a68f6-5d08-4008-abaa-31913eaa3065 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.648176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.649958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.650309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.652011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.652696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.654625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.666672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 985/1985] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:22.672039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.720332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f76776-82c6-42dc-8afa-61d8e6925391 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.729204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813f006-5d46-4cc0-9298-d440d2d9ea6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.729825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f006-5d46-4cc0-9298-d440d2d9ea6f admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.730287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f006-5d46-4cc0-9298-d440d2d9ea6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.730691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813f006-5d46-4cc0-9298-d440d2d9ea6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.731557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f006-5d46-4cc0-9298-d440d2d9ea6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.734324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813f006-5d46-4cc0-9298-d440d2d9ea6f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.769730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1001/1986] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:22.770908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.785840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3f77-3dcd-473d-9b45-f4b46f368771 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:22.803402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:22.804160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.804589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.804870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] PATH_INFO: `/v3/projects/1d3aba860f71491991e7eed4a616e09e/users/9ab624a4b629425cbe5be6aa3d8f8ef5/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.832375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3aba860f71491991e7eed4a616e09e, user_id=9ab624a4b629425cbe5be6aa3d8f8ef5, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:22.836862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:22.874881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:22.875167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:22.875498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:22.878414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 986/1987] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:22 2022] PUT /identity/v3/projects/1d3aba860f71491991e7eed4a616e09e/users/9ab624a4b629425cbe5be6aa3d8f8ef5/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:22.911694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] MFA Rules not processed for user `9ab624a4b629425cbe5be6aa3d8f8ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:22.913563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:22.968752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:22.972129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:22.974321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.065181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1002/1988] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:23.102754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237d45-ed73-452f-a31c-5d6f6bd48e12 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.112436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.113346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.113773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.114366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] PATH_INFO: `/v3/users/a68f7683664442ddb7acb14d938ea6ac` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.115529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.116212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a68f7683664442ddb7acb14d938ea6ac)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.117836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.119006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.186717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:23.196512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a68f7683664442ddb7acb14d938ea6ac'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.210736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a68f7683664442ddb7acb14d938ea6ac'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.211976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a68f7683664442ddb7acb14d938ea6ac'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.216002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da164a-1d35-40dd-a5a2-91a00999b96c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.220131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.220749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.221026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.221293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.230844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.232360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.241065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a68f7683664442ddb7acb14d938ea6ac'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.241811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-95ca37e7-19fc-49a5-ae69-7d9b3690e5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a68f7683664442ddb7acb14d938ea6ac'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.248447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1003/1989] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:23.264605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.269955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 987/1990] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:22 2022] DELETE /identity/v3/users/a68f7683664442ddb7acb14d938ea6ac => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:23.274226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.274715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.276283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.277907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79d9b83-26e1-446b-a1fa-597b477213f9 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.304490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:23.307335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.365216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.366186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.366594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.366870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] PATH_INFO: `/v3/users/9ab624a4b629425cbe5be6aa3d8f8ef5` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.368082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab624a4b629425cbe5be6aa3d8f8ef5)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.370137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.398521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 988/1991] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:23.409633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.412978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.429013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab624a4b629425cbe5be6aa3d8f8ef5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.438690 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab624a4b629425cbe5be6aa3d8f8ef5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.439423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab624a4b629425cbe5be6aa3d8f8ef5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.440321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab624a4b629425cbe5be6aa3d8f8ef5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.451771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:23.460281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddb4010c-188d-4137-a7b6-fb912fb77789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab624a4b629425cbe5be6aa3d8f8ef5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:23.482076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1004/1992] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:23 2022] DELETE /identity/v3/users/9ab624a4b629425cbe5be6aa3d8f8ef5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:23.486513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.486914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.487125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.493395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de9a63a-18ac-494f-89a5-2d254a486a2a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.508259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:23.509475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.545042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.545657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.546042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.546343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.548117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.575136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1005/1993] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:23.581989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:23.586100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:23.587838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:23.602578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d3aaa-90fa-4769-8930-af5620a8450a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:23.607249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:23.607864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:23.608175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:23.608460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:23.620125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.621628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.629343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:23.630791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:23.632325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1006/1994] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:23.643877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 989/1995] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:24.172918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.174655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.214439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e2caec-fff5-465c-b4ef-621d51a9ab48 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.223232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.224617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.225128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.225573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] PATH_INFO: `/v3/projects/1d3aba860f71491991e7eed4a616e09e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.234463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3aba860f71491991e7eed4a616e09e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.238403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.253269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.254996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.271584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bbdb4-910b-4f9f-b2bb-6e81aa5cdc96 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.285956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.286833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.287151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.287454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] PATH_INFO: `/v3/projects/4b0c92473c7b41d19e7f5a1a42a752a8` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.288812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b0c92473c7b41d19e7f5a1a42a752a8)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.291733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.327521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3aba860f71491991e7eed4a616e09e', 'request_id': 'req-68985d81-eb64-40e7-adff-54d2ba05756a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.355600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b0c92473c7b41d19e7f5a1a42a752a8', 'request_id': 'req-75abba6b-5c1c-4d83-8452-89becad49944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.357312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3aba860f71491991e7eed4a616e09e', 'request_id': 'req-68985d81-eb64-40e7-adff-54d2ba05756a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.363384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b0c92473c7b41d19e7f5a1a42a752a8', 'request_id': 'req-75abba6b-5c1c-4d83-8452-89becad49944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.370964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b0c92473c7b41d19e7f5a1a42a752a8', 'request_id': 'req-75abba6b-5c1c-4d83-8452-89becad49944'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.387403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3aba860f71491991e7eed4a616e09e', 'request_id': 'req-68985d81-eb64-40e7-adff-54d2ba05756a'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.395450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] The token cache is being invalidate because project 4b0c92473c7b41d19e7f5a1a42a752a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:24.395756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.396487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.401806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 990/1996] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:24 2022] DELETE /identity/v3/projects/4b0c92473c7b41d19e7f5a1a42a752a8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:24.403088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.405623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.407207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] The token cache is being invalidate because project 1d3aba860f71491991e7eed4a616e09e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:24.407503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.410471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-68985d81-eb64-40e7-adff-54d2ba05756a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.413827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1007/1997] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:24 2022] DELETE /identity/v3/projects/1d3aba860f71491991e7eed4a616e09e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:24.432570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.432570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.432570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.483015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:24.483932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.499496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75abba6b-5c1c-4d83-8452-89becad49944 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.511989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.512504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1008/1998] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:24.513407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.516737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.517259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] PATH_INFO: `/v3/users/ba84598e2e2c43be8eea35d5ff42305f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.519116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba84598e2e2c43be8eea35d5ff42305f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.519572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.521496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.521642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.580743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:24.588884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7fa630-ac08-4b76-975f-162aa4e8dcb1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.594281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.595163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.595635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.596372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.599421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.602205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba84598e2e2c43be8eea35d5ff42305f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.613186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:24.614425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba84598e2e2c43be8eea35d5ff42305f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.615720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba84598e2e2c43be8eea35d5ff42305f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.632282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba84598e2e2c43be8eea35d5ff42305f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.633090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b3329804-a917-4ae6-97f9-97d115535275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba84598e2e2c43be8eea35d5ff42305f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:24.647864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 991/1999] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:24 2022] DELETE /identity/v3/users/ba84598e2e2c43be8eea35d5ff42305f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:24.649276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.649583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.649857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.685544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:24.688261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.706131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.708506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.733838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1009/2000] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:24.734935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.742350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:24.781196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98db2f55-ed57-44ef-bf61-e5aa93fbceb9 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.805809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 992/2001] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:24.811131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.833003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdccd109-b900-4b28-a620-18b3df38e0e3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.850861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.851528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.851815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.852146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.852968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:24.853298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.855704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.878246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 993/2002] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:24.884188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:24.899659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edfcb35-ab5d-4af6-b479-be9ef60f72bd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:24.911574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.913086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.913398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.914019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.914691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.918848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.939481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:24.940270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:24.940652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:24.941274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] PATH_INFO: `/v3/users/5576ecb6dfc14bc0b61136599278b804` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:24.944249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5576ecb6dfc14bc0b61136599278b804)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:24.947710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:24.981355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 994/2003] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:24.985077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.052016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5576ecb6dfc14bc0b61136599278b804'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.067024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5576ecb6dfc14bc0b61136599278b804'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.068990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5576ecb6dfc14bc0b61136599278b804'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.070495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5576ecb6dfc14bc0b61136599278b804'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.104488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5576ecb6dfc14bc0b61136599278b804'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.134608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1010/2004] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:24 2022] DELETE /identity/v3/users/5576ecb6dfc14bc0b61136599278b804 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:25.136114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.137864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.154113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727e90d1-4043-4b46-be86-8920c12f607f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.164932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:25.295814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa97aa61-8e56-482c-ba16-b30193af9bf1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.296322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:25.308163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.310451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.310806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.310984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] PATH_INFO: `/v3/projects/828eb7dbc56e483fae83b19183c2fa75` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.316505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=828eb7dbc56e483fae83b19183c2fa75)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.318480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.333951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1885539-3778-4ee0-a9c8-803530496fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.349234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885539-3778-4ee0-a9c8-803530496fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.350028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885539-3778-4ee0-a9c8-803530496fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.350451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1885539-3778-4ee0-a9c8-803530496fa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.351646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1885539-3778-4ee0-a9c8-803530496fa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.354695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1885539-3778-4ee0-a9c8-803530496fa6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.391056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 995/2005] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:24 2022] POST /identity/v3/users => generated 287 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:25.396270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e846d4-4a71-4794-a424-e2fad8058507 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.396839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e846d4-4a71-4794-a424-e2fad8058507 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.397300 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e846d4-4a71-4794-a424-e2fad8058507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.425903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-61e846d4-4a71-4794-a424-e2fad8058507 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:25.436725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-61e846d4-4a71-4794-a424-e2fad8058507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.439807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '828eb7dbc56e483fae83b19183c2fa75', 'request_id': 'req-c9685e21-a2c9-46c3-a665-7961aab7b2fe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.466767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '828eb7dbc56e483fae83b19183c2fa75', 'request_id': 'req-c9685e21-a2c9-46c3-a665-7961aab7b2fe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.479155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '828eb7dbc56e483fae83b19183c2fa75', 'request_id': 'req-c9685e21-a2c9-46c3-a665-7961aab7b2fe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.508303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] The token cache is being invalidate because project 828eb7dbc56e483fae83b19183c2fa75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:25.508605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.509408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:25.511050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1011/2006] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:25 2022] DELETE /identity/v3/projects/828eb7dbc56e483fae83b19183c2fa75 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:25.511832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.514528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.553722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 996/2007] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:25.558233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.558516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.558795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.606846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:25.609867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.648856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 997/2008] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:25.648856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.648856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.771788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685e21-a2c9-46c3-a665-7961aab7b2fe admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.797263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82407add-30b4-4036-a65b-a84a0b35a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.797904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407add-30b4-4036-a65b-a84a0b35a89e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.798706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407add-30b4-4036-a65b-a84a0b35a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.798706 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82407add-30b4-4036-a65b-a84a0b35a89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.800154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82407add-30b4-4036-a65b-a84a0b35a89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.804532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82407add-30b4-4036-a65b-a84a0b35a89e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.820762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2003a-0558-4e10-91f3-e15d51167e4b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.833020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.834074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.834839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.836383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1012/2009] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:25.836753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.838283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.838570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.839345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.865957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.867846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.883979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 998/2010] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:25.885956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.889147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:25.890553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:25.901602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9c0a-f82c-42e4-9377-dbd7bc3d01dc service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.908948 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1013/2011] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:25.916493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.917126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.917406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.917684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.918351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.920016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.928331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.936143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 999/2012] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:25.941664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:25.956349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4e2ad-fec1-4b41-bd9a-eacf65319b94 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.966930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47511e73-86de-4527-ad5c-3f5f21449f72 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:25.968016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698bc1d-37f0-4825-9433-0ad398ce2fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.968798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bc1d-37f0-4825-9433-0ad398ce2fce admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.969149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bc1d-37f0-4825-9433-0ad398ce2fce admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.969500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698bc1d-37f0-4825-9433-0ad398ce2fce admin admin] PATH_INFO: `/v3/projects/538aca329ac84cd59b2448674d51257e/users/c6a65f92ecf245b5a1cc616db43df55e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.980767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:25.981725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:25.982003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:25.982271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:25.982971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:25.983278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:25.985881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:25.998252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bc1d-37f0-4825-9433-0ad398ce2fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=538aca329ac84cd59b2448674d51257e, user_id=c6a65f92ecf245b5a1cc616db43df55e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.003097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698bc1d-37f0-4825-9433-0ad398ce2fce admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.043815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1000/2013] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:25 2022] PUT /identity/v3/projects/538aca329ac84cd59b2448674d51257e/users/c6a65f92ecf245b5a1cc616db43df55e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:26.050716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1014/2014] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:26.056046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.056338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.056626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.060260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.083708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf54ad-fb50-4751-8597-a63e5c18e6cc admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.139790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] MFA Rules not processed for user `c6a65f92ecf245b5a1cc616db43df55e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:26.140892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:26.143752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.176905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.257348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.258254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.258609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.258955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.260985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.262817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.294945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1001/2015] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:26.308861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.310861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:26.347248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1015/2016] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:26 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:26.348397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.465269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327b5d30-c7c0-4286-902d-f749f35b5091 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.495810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36d880-813b-4180-8d84-19c67a5a528c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.501878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.502771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.503153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.503601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.504460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.507218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.567012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1016/2017] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:26 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:26.569183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.573751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:26.590016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.590791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.591093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.591371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.601079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46bdf-5422-4340-8b81-476a13a696a1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.608995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.609971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.610269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.610657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] PATH_INFO: `/v3/projects/d442b0d59ade49b68285c7d158648961` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.611967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d442b0d59ade49b68285c7d158648961)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.615180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.683517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.687511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.704266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1002/2018] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:26.706772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.732304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd442b0d59ade49b68285c7d158648961', 'request_id': 'req-d5078e37-b4e0-4cbe-a2f0-5d0345437281'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:26.767669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b65a7-1d87-4fcb-9ef3-80fe62771a26 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.770601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd442b0d59ade49b68285c7d158648961', 'request_id': 'req-d5078e37-b4e0-4cbe-a2f0-5d0345437281'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:26.792400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd442b0d59ade49b68285c7d158648961', 'request_id': 'req-d5078e37-b4e0-4cbe-a2f0-5d0345437281'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:26.825126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] The token cache is being invalidate because project d442b0d59ade49b68285c7d158648961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:26.825491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:26.826169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:26.828683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1017/2019] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:26 2022] DELETE /identity/v3/projects/d442b0d59ade49b68285c7d158648961 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:26.833061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.835727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:26.856750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.908169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:26.911361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.915457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.915797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.919912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.919912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.930361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:26.957100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1003/2020] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:26.959134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:26.967760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:26.980844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5078e37-b4e0-4cbe-a2f0-5d0345437281 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:26.988340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:26.989668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:26.990410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:26.990927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] PATH_INFO: `/v3/users/066e9fc5c30143528d36b20600244750` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:26.993727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=066e9fc5c30143528d36b20600244750)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:26.997231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.001850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26164ca-c4ce-4b40-9458-9dccca24844e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.021903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.022120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.026164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.026948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.027983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.033222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.079159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1004/2021] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:27.080192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.108990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44599bad-22d5-43bc-9e54-ee116d84410c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.118335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '066e9fc5c30143528d36b20600244750'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:27.123126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64bcc0c-39b4-490f-8f8a-1a894183eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.123914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bcc0c-39b4-490f-8f8a-1a894183eed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.126936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bcc0c-39b4-490f-8f8a-1a894183eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.127329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64bcc0c-39b4-490f-8f8a-1a894183eed4 admin admin] PATH_INFO: `/v3/projects/fd454516151a49b38ddbd58a351d2484/users/aecc3a09b79e48529634ee2dcb8e1ca2/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.133300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '066e9fc5c30143528d36b20600244750'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:27.134168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '066e9fc5c30143528d36b20600244750'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:27.135700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '066e9fc5c30143528d36b20600244750'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:27.167809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bcc0c-39b4-490f-8f8a-1a894183eed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd454516151a49b38ddbd58a351d2484, user_id=aecc3a09b79e48529634ee2dcb8e1ca2, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.168700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '066e9fc5c30143528d36b20600244750'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:27.173893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64bcc0c-39b4-490f-8f8a-1a894183eed4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.203990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1005/2022] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:27 2022] PUT /identity/v3/projects/fd454516151a49b38ddbd58a351d2484/users/aecc3a09b79e48529634ee2dcb8e1ca2/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:27.215694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.215981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.216701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.224327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1018/2023] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:26 2022] DELETE /identity/v3/users/066e9fc5c30143528d36b20600244750 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:27.285293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:27.286663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:27.396189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1006/2024] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:27.423192 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:27.425731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:27.548710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ffa3da-73de-4546-96bf-d235376fe7a2 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:27.559207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:27.560245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:27.561025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:27.561353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:27.581315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:27.583369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:27.599568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1019/2025] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:28.140412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.140412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:28.155608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19940c5-834c-4423-a1dd-4541c31d64c5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.161480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:28.162403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.163695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.164478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] PATH_INFO: `/v3/projects/2c1d62ee9d1e472bb59abaebe99bccac` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.166401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c1d62ee9d1e472bb59abaebe99bccac)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:28.170453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.211062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.214226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:28.257034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c1d62ee9d1e472bb59abaebe99bccac', 'request_id': 'req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.264119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbee908-217f-4de9-b1d8-1ffd19d8e0aa service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.282384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c1d62ee9d1e472bb59abaebe99bccac', 'request_id': 'req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.291472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c1d62ee9d1e472bb59abaebe99bccac', 'request_id': 'req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.336445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] The token cache is being invalidate because project 2c1d62ee9d1e472bb59abaebe99bccac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:28.336765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.340907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.343101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1007/2026] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:28 2022] DELETE /identity/v3/projects/2c1d62ee9d1e472bb59abaebe99bccac => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:28.348299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.350790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:28.353103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:28.383639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:28.384498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.385680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.386524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] PATH_INFO: `/v3/users/83473d7e5add4d6ea260038a0504d2f9` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.387928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] RBAC: Authorizing `identity:delete_user(user_id=83473d7e5add4d6ea260038a0504d2f9)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:28.390944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.421003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:28.580728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83473d7e5add4d6ea260038a0504d2f9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.597171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83473d7e5add4d6ea260038a0504d2f9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.598000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83473d7e5add4d6ea260038a0504d2f9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.598821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83473d7e5add4d6ea260038a0504d2f9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.604418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fb8ffe-0a23-46a2-b37b-d00a7ff7ee4f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.614947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5133fd96-0e22-455a-8064-7ee51dec432a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83473d7e5add4d6ea260038a0504d2f9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.628973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:28.629930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.630207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.630478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] PATH_INFO: `/v3/users/af418d5dfa884d679431b40be614d0b7` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.632935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1020/2027] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:28 2022] DELETE /identity/v3/users/83473d7e5add4d6ea260038a0504d2f9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:28.636150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] RBAC: Authorizing `identity:delete_user(user_id=af418d5dfa884d679431b40be614d0b7)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:28.638434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:28.638815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:28.639110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:28.640921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:28.693264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:28.697728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:28.740618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af418d5dfa884d679431b40be614d0b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.769418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af418d5dfa884d679431b40be614d0b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.770411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af418d5dfa884d679431b40be614d0b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.790528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af418d5dfa884d679431b40be614d0b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.792116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af418d5dfa884d679431b40be614d0b7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:28.796005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1021/2028] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:28.805581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:28.807430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:28.816349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1008/2029] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:28 2022] DELETE /identity/v3/users/af418d5dfa884d679431b40be614d0b7 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:28.901601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e2552-0dda-4e95-b833-90f4b3c2c7ec None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:28.948381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:29.023255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:29.024713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:29.026167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:29.026676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:29.031086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:29.228752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:29.235296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98539d93-20aa-4018-996b-7c5c17c3de42 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:29.268286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1022/2030] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:29.558303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:29.560651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:29.590126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d548954-f55b-4a78-a607-f11824a2308c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:29.599479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:29.600584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:29.601230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:29.602003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] PATH_INFO: `/v3/projects/938f2c14929443ecaafb5a7869ff9dcd` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:29.605913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] RBAC: Authorizing `identity:delete_project(project_id=938f2c14929443ecaafb5a7869ff9dcd)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:29.609488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:29.724262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '938f2c14929443ecaafb5a7869ff9dcd', 'request_id': 'req-e8768339-ba4d-4482-a32d-40ce75aad46e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:29.763901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '938f2c14929443ecaafb5a7869ff9dcd', 'request_id': 'req-e8768339-ba4d-4482-a32d-40ce75aad46e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:29.787324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:29.787824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:29.788196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:29.789456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '938f2c14929443ecaafb5a7869ff9dcd', 'request_id': 'req-e8768339-ba4d-4482-a32d-40ce75aad46e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:29.814789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] The token cache is being invalidate because project 938f2c14929443ecaafb5a7869ff9dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:29.815464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:29.817402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e8768339-ba4d-4482-a32d-40ce75aad46e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:29.819551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1009/2031] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:29 2022] DELETE /identity/v3/projects/938f2c14929443ecaafb5a7869ff9dcd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:29.827044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:29.827779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:29.828517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:29.852875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] MFA Rules not processed for user `aecc3a09b79e48529634ee2dcb8e1ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:29.858104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:29.876791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:29.887270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:29.939671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.008945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1023/2032] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:30.011048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.015382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.024145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1010/2033] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:30.024145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.032249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.037073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb382a1d-fc4a-40aa-bdc6-4b41f770c834 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.043555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.044617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.045376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.045376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] PATH_INFO: `/v3/projects/20f84a2dac894244a22b0e06e299dd51` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.046393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f84a2dac894244a22b0e06e299dd51)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.047170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b0c46-3de8-476a-b5e2-2e40d1f96454 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.049342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.054066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c819d-a262-41b8-8488-e45a02365017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.055225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c819d-a262-41b8-8488-e45a02365017 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.055841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c819d-a262-41b8-8488-e45a02365017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.056444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c819d-a262-41b8-8488-e45a02365017 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.057832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c819d-a262-41b8-8488-e45a02365017 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.062088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c819d-a262-41b8-8488-e45a02365017 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.112482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1011/2034] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:30.114374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.114751 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.115081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.136672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:30.138037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.149341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f84a2dac894244a22b0e06e299dd51', 'request_id': 'req-ddad30c8-0605-4401-a3d3-1140ddb99774'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.158578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f84a2dac894244a22b0e06e299dd51', 'request_id': 'req-ddad30c8-0605-4401-a3d3-1140ddb99774'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.162560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.172317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f84a2dac894244a22b0e06e299dd51', 'request_id': 'req-ddad30c8-0605-4401-a3d3-1140ddb99774'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.199245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] The token cache is being invalidate because project 20f84a2dac894244a22b0e06e299dd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:30.212064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.214875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.223036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1024/2035] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:30 2022] DELETE /identity/v3/projects/20f84a2dac894244a22b0e06e299dd51 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:30.224033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.230762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.243128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1012/2036] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:30.247992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.250363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.283495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc53dae-6079-4bea-99c7-51f803939a52 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.288958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad30c8-0605-4401-a3d3-1140ddb99774 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.297059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.298374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.299794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.300904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] PATH_INFO: `/v3/users/47cf124b36e04dec9dd64720c6c7383d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.302375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.303540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.304478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cf124b36e04dec9dd64720c6c7383d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.304861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.307209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.307632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.308850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.310457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.353960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1025/2037] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:30.355613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.377352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ad33e-5a92-4526-8e62-bcdc3a6839a6 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.391898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.393124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.393402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.393721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.396281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:30.396611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.408452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.408563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cf124b36e04dec9dd64720c6c7383d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.428647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cf124b36e04dec9dd64720c6c7383d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.429924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cf124b36e04dec9dd64720c6c7383d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.450385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1026/2038] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:30.451269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.456801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cf124b36e04dec9dd64720c6c7383d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.458075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cf124b36e04dec9dd64720c6c7383d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:30.467600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717072e7-a8d4-4cc4-98e6-b41e8673c8cb admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.472821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.474168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.474168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.474168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.474695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.476478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.481885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1013/2039] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:30 2022] DELETE /identity/v3/users/47cf124b36e04dec9dd64720c6c7383d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:30.483038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.484792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.512635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1027/2040] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:30.520435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.523314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:30.525937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.564633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a09839-49f0-43e0-99d0-9abaa1a0adda admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.671146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.671841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.672162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.672442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] PATH_INFO: `/v3/projects/5dfa2e1c50be4148ba054efbb0c7ac63/users/9be0726bb3454e6f995c2f6a86026031/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.695492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3993a9-ef29-4da2-b73d-1ac517e07b5c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.709813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.710525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.711774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.711774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.711774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.714520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.722428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfa2e1c50be4148ba054efbb0c7ac63, user_id=9be0726bb3454e6f995c2f6a86026031, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.725843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.749901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1028/2041] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:30 2022] PUT /identity/v3/projects/5dfa2e1c50be4148ba054efbb0c7ac63/users/9be0726bb3454e6f995c2f6a86026031/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:30.752800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1014/2042] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/projects => generated 383 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:30.756791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.756952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:30.864399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035302c8-c1f8-4e92-8d45-0a3ff9144e78 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.907581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:30.926114 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e69c-6bce-4023-87db-993cc867cfdd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:30.944041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.950676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.951968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.952482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.953926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.958834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:30.959661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:30.959958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:30.960538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:30.961202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:30.962393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.962976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:30.977065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1029/2043] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:30.984893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.000408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da19b6af-06c4-42f1-9adb-95d34e45e29c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.005682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.006792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.006792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.007026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] PATH_INFO: `/v3/projects/5dfa2e1c50be4148ba054efbb0c7ac63/users/9be0726bb3454e6f995c2f6a86026031/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.008370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1015/2044] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:30 2022] POST /identity/v3/users => generated 292 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:31.010311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dfa2e1c50be4148ba054efbb0c7ac63, user_id=9be0726bb3454e6f995c2f6a86026031, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.011819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.014078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.027711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1030/2045] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:30 2022] PUT /identity/v3/projects/5dfa2e1c50be4148ba054efbb0c7ac63/users/9be0726bb3454e6f995c2f6a86026031/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:31.030613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3e378-61d8-49c7-9d16-d12e1d190c80 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.092480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.094668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:31.222726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.223338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.223664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.223940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.224772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.226409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.239629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1016/2046] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:31.245868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.259027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83944249-2768-43c4-bbfd-a5e896130c15 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.265987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.266826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.267299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.267418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.268426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.270490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.308842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1017/2047] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:31.311995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.333308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461b60b4-1508-4b1c-821f-7da7f0ca4317 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.341333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5432d21-de84-44c7-8321-fc689a9936b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.342191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5432d21-de84-44c7-8321-fc689a9936b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.342476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5432d21-de84-44c7-8321-fc689a9936b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.342811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5432d21-de84-44c7-8321-fc689a9936b6 admin admin] PATH_INFO: `/v3/projects/00cf36408f474a75864fca2d52646160/users/b389bfe258f345be8ab7dd641768831d/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.355346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:31.364779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5432d21-de84-44c7-8321-fc689a9936b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00cf36408f474a75864fca2d52646160, user_id=b389bfe258f345be8ab7dd641768831d, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.368347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5432d21-de84-44c7-8321-fc689a9936b6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.391976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfafba4-be2c-4539-ae4b-9cdb73ffdb79 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.404732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1018/2048] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:31 2022] PUT /identity/v3/projects/00cf36408f474a75864fca2d52646160/users/b389bfe258f345be8ab7dd641768831d/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:31.415269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.416076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.416706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.473126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] MFA Rules not processed for user `b389bfe258f345be8ab7dd641768831d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:31.474657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:31.518579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.519556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.519937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.520470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] PATH_INFO: `/v3/users/c6a65f92ecf245b5a1cc616db43df55e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.521934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6a65f92ecf245b5a1cc616db43df55e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.524498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.596169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6a65f92ecf245b5a1cc616db43df55e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:31.609606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6a65f92ecf245b5a1cc616db43df55e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:31.610597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6a65f92ecf245b5a1cc616db43df55e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:31.611468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6a65f92ecf245b5a1cc616db43df55e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:31.624512 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:31.638206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f20b79c1-aad0-41d2-bd61-9e72bcdc9253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6a65f92ecf245b5a1cc616db43df55e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:31.638418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1019/2049] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:31.642606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.655683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4669-0970-4f50-859e-08a83c1c0149 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.667975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1031/2050] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:31 2022] DELETE /identity/v3/users/c6a65f92ecf245b5a1cc616db43df55e => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:31.673576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.673779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.674075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.674294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.674529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.674637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.674827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.675476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.677453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.711601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:31.713122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:31.746971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1020/2051] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:31 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:31.763490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.772282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:31.871991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1032/2052] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:31.876381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:31.876868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:31.939805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7c890-c427-4684-86fc-7329b5eabd46 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.940769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f848e8-b564-4b7c-9711-53ed73f62244 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:31.952982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.953639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.953921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.954215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.954852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.959742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:31.967786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:31.968998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:31.969284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:31.969561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] PATH_INFO: `/v3/projects/814a1b14ead944c0bcc91d06a760948a` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:31.970969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] RBAC: Authorizing `identity:delete_project(project_id=814a1b14ead944c0bcc91d06a760948a)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:31.973019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.005596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1021/2053] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:31 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:32.007032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.009099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.055361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814a1b14ead944c0bcc91d06a760948a', 'request_id': 'req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.069238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814a1b14ead944c0bcc91d06a760948a', 'request_id': 'req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.084073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814a1b14ead944c0bcc91d06a760948a', 'request_id': 'req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.101644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] The token cache is being invalidate because project 814a1b14ead944c0bcc91d06a760948a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:32.102640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.103874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.106830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1033/2054] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:31 2022] DELETE /identity/v3/projects/814a1b14ead944c0bcc91d06a760948a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:32.107813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:32.124786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.125025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3a84-29f9-46f7-b7d7-2624308e538d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.133107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.242449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.243507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.244710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.244987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.247211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.299698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5cfc-3e0e-4ad0-bd20-0b875b83477f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.306310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.307063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.307344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.307620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.308295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.311055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.324204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.329561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1034/2055] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:32.329766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.329926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.329926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.337639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:32.339487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1022/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:32.340502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.352157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31293f35-b6c2-49a9-8a29-a2d486b2b027 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.352592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.354202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.354925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.355697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] PATH_INFO: `/v3/users/6d6d1398f9de44f09ce4e3390ea7261c` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.355863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7100ab4-ec1e-4862-9650-1c277c4a0cdf service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.357627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6d1398f9de44f09ce4e3390ea7261c)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.360160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.372115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f969d-046e-4a00-a1ab-de80b26b4da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.372840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f969d-046e-4a00-a1ab-de80b26b4da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.373117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f969d-046e-4a00-a1ab-de80b26b4da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.374468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f969d-046e-4a00-a1ab-de80b26b4da2 admin admin] PATH_INFO: `/v3/projects/f42d462052204c5eb37d6e70fa50b9bc/users/ef8e4262f32a4b9899d257bdbde12567/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.410826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f969d-046e-4a00-a1ab-de80b26b4da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42d462052204c5eb37d6e70fa50b9bc, user_id=ef8e4262f32a4b9899d257bdbde12567, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.413851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f969d-046e-4a00-a1ab-de80b26b4da2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.436834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6d1398f9de44f09ce4e3390ea7261c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.444666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1023/2057] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:32 2022] PUT /identity/v3/projects/f42d462052204c5eb37d6e70fa50b9bc/users/ef8e4262f32a4b9899d257bdbde12567/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:32.446803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3406d-454f-4898-99f3-d6f2ebb3c71b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.448298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3406d-454f-4898-99f3-d6f2ebb3c71b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.450824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3406d-454f-4898-99f3-d6f2ebb3c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.456400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6d1398f9de44f09ce4e3390ea7261c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.457190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6d1398f9de44f09ce4e3390ea7261c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.458264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6d1398f9de44f09ce4e3390ea7261c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.494817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6d1398f9de44f09ce4e3390ea7261c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:32.532137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1035/2058] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:32 2022] DELETE /identity/v3/users/6d6d1398f9de44f09ce4e3390ea7261c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:32.532137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.532137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.551578 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-eab3406d-454f-4898-99f3-d6f2ebb3c71b None None] MFA Rules not processed for user `9be0726bb3454e6f995c2f6a86026031`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:32.553040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-eab3406d-454f-4898-99f3-d6f2ebb3c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.631726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8060cd29-cb38-431f-8fcd-d5553265c5bf admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.638489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.639323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.639494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.639728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.640408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.642339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.660110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1036/2059] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:32.663839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.688031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e65bd6-95f8-4d31-a2ed-b82a2ec9fe0d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:32.697831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ebd444-48bc-4b24-864b-c2c40fcd9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:32.698799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebd444-48bc-4b24-864b-c2c40fcd9c56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.699110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebd444-48bc-4b24-864b-c2c40fcd9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.699739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ebd444-48bc-4b24-864b-c2c40fcd9c56 admin admin] PATH_INFO: `/v3/projects/f42d462052204c5eb37d6e70fa50b9bc/users/ef8e4262f32a4b9899d257bdbde12567/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.702142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebd444-48bc-4b24-864b-c2c40fcd9c56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42d462052204c5eb37d6e70fa50b9bc, user_id=ef8e4262f32a4b9899d257bdbde12567, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:32.706710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ebd444-48bc-4b24-864b-c2c40fcd9c56 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:32.721412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1037/2060] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:32 2022] PUT /identity/v3/projects/f42d462052204c5eb37d6e70fa50b9bc/users/ef8e4262f32a4b9899d257bdbde12567/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:32.731796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.733514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1024/2061] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:32.734039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.734494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.747791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:32.748346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:32.748423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:32.771827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] MFA Rules not processed for user `aecc3a09b79e48529634ee2dcb8e1ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:32.773200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.780420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:32.797181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] MFA Rules not processed for user `ef8e4262f32a4b9899d257bdbde12567`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:32.798505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.864353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:32.865608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1025/2062] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:32.878436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.880109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:32.931195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1038/2063] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:32.942926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:32.944402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.011597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3932a8c1-3bfa-4933-9080-3e219f972455 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.017450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.018074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.018351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.018624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.020577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.031852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.033609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.044461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1026/2064] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:33.045328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.046685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd5ad-199f-49c6-a091-220dc41797a5 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.046973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.055260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.055760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.056017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.056368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.081966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.083471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.103179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1039/2065] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:33.104271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.105974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.179797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e93441-fc0d-4172-9df8-21a705b4f75a service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.190766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.192049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.192673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.193828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] PATH_INFO: `/v3/projects/538aca329ac84cd59b2448674d51257e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.195121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538aca329ac84cd59b2448674d51257e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.197568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.202019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfab23-1cb3-4b7f-931b-b8e1490980c0 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.209210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.210181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.210667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.211176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] PATH_INFO: `/v3/projects/fea301321bc340c896a2d9712b83748f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.212693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fea301321bc340c896a2d9712b83748f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.215096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.264016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:33.270292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538aca329ac84cd59b2448674d51257e', 'request_id': 'req-226503df-f4b3-47c9-91d7-87b375691e79'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.278635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538aca329ac84cd59b2448674d51257e', 'request_id': 'req-226503df-f4b3-47c9-91d7-87b375691e79'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.286214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538aca329ac84cd59b2448674d51257e', 'request_id': 'req-226503df-f4b3-47c9-91d7-87b375691e79'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.310897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fea301321bc340c896a2d9712b83748f', 'request_id': 'req-bbbef9ba-e480-4798-bf91-637c09d7d731'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.316967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] The token cache is being invalidate because project 538aca329ac84cd59b2448674d51257e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:33.317388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.319559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-226503df-f4b3-47c9-91d7-87b375691e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.321964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1027/2066] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:33 2022] DELETE /identity/v3/projects/538aca329ac84cd59b2448674d51257e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:33.332614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fea301321bc340c896a2d9712b83748f', 'request_id': 'req-bbbef9ba-e480-4798-bf91-637c09d7d731'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.333561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb39a-a1eb-4471-be84-4cd8f9b84506 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.333846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb39a-a1eb-4471-be84-4cd8f9b84506 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.334117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aceb39a-a1eb-4471-be84-4cd8f9b84506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.353357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fea301321bc340c896a2d9712b83748f', 'request_id': 'req-bbbef9ba-e480-4798-bf91-637c09d7d731'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.364899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3aceb39a-a1eb-4471-be84-4cd8f9b84506 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:33.366473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3aceb39a-a1eb-4471-be84-4cd8f9b84506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.375988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] The token cache is being invalidate because project fea301321bc340c896a2d9712b83748f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:33.378385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.379902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:33.393262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1040/2067] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:33 2022] DELETE /identity/v3/projects/fea301321bc340c896a2d9712b83748f => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:33.393262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.393262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.454631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:33.495858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1028/2068] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:33.495858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d532f2-23ee-4763-9537-997050468df5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.495858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d532f2-23ee-4763-9537-997050468df5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.495858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d532f2-23ee-4763-9537-997050468df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.536518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-53d532f2-23ee-4763-9537-997050468df5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:33.537753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-53d532f2-23ee-4763-9537-997050468df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.552334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1029/2069] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:33.552519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbef9ba-e480-4798-bf91-637c09d7d731 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.553948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4083e5-9dee-44f5-ae75-efcbbe640ee1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.554221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4083e5-9dee-44f5-ae75-efcbbe640ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.554494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4083e5-9dee-44f5-ae75-efcbbe640ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.574367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.575916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.576537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.576913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.579736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.596998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7c4083e5-9dee-44f5-ae75-efcbbe640ee1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:33.598398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7c4083e5-9dee-44f5-ae75-efcbbe640ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.615260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1030/2070] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:33.616950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.617334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.617712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.646995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:33.649551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:33.669736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1031/2071] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:33.669736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.682082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce42b28-b727-42c6-a8ea-2cd8276f7b31 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.688052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.689092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.689522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.689933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.690764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:33.691112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.693302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.707698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1032/2072] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:33.708605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.720779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.722576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.723869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3f763-0114-4fcd-a0b2-0813b6f42365 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.730175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.731384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.731976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.732450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.733396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:33.733944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.736433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.746322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1041/2073] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:33.747583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.761324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1033/2074] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:33.763302 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31ef90-2adc-4f7d-b581-13959d586f37 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.765603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.768870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.769597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.769972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.770355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.771479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.774799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.789194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ad9b2-e71d-42aa-b055-7d25e7deb8ef admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:33.805998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:33.806690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:33.806971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:33.807278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:33.816104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:33.819412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:33.839821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1042/2075] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/projects => generated 371 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:33.845774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:33.915839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1034/2076] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:33.934477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.050454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7861385-e2be-4500-9a9e-4816b3ea287b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.077030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6edaeef-df59-4cec-987c-f9d4a5e3ebc2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.089777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.090422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.093254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.093581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.094331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.097719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.122980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:34.149220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1035/2077] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:34.152002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.154301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:34.180336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.182274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.182752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.183355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.183974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6acbc-6af3-49bf-b853-f37e7b939a5e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.184445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.186767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.200629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.201225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.201579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.202586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.218602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.218602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.237208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1043/2078] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:33 2022] POST /identity/v3/users => generated 286 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:34.246526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1036/2079] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:34.249239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.250740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.274170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251ad4e-1008-4755-bc88-0317695eb888 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.284413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd562a-d7d3-49bc-ba11-6669c7bdc7d7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.295365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.296022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.296295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.299822 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.301014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.302065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.303724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.305340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.305623 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.305898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.307095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.308909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.325730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1037/2080] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:34.332059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.336573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1044/2081] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:34.341160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.347656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e578f1-7e44-4645-abe3-29b4d98abb9c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.353918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.354891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.355176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.355521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] PATH_INFO: `/v3/projects/d6f64107ddd64ec7a648bd27f0783165/users/7ff0f29401a149bc95b46bcd350d58a5/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.369967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d69727-4a70-4d10-adca-b2b918b3c4b0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.381778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6f64107ddd64ec7a648bd27f0783165, user_id=7ff0f29401a149bc95b46bcd350d58a5, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.382660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.383579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.384309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.385341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.385635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.386539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.390453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.402832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1038/2082] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:34 2022] PUT /identity/v3/projects/d6f64107ddd64ec7a648bd27f0783165/users/7ff0f29401a149bc95b46bcd350d58a5/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:34.405136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1045/2083] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:34.414966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.415665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.418225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:34.456432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07aaf-87f5-4973-86d0-432e47605b9d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.510305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf64de0-dcce-4ee4-b7c3-d542aad28687 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.519796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2e129-7bfc-48f6-9928-80bc81d83507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.520876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e129-7bfc-48f6-9928-80bc81d83507 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.521374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e129-7bfc-48f6-9928-80bc81d83507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.521793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e129-7bfc-48f6-9928-80bc81d83507 admin admin] PATH_INFO: `/v3/projects/bfe63919621c4b3caa724a147b2d1afe/users/2e7554f1186c4f84be02d67169ba3b62/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.564859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e129-7bfc-48f6-9928-80bc81d83507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe63919621c4b3caa724a147b2d1afe, user_id=2e7554f1186c4f84be02d67169ba3b62, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.577445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.578203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.578746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.579068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] PATH_INFO: `/v3/users/b389bfe258f345be8ab7dd641768831d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.580157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e129-7bfc-48f6-9928-80bc81d83507 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.581263 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b389bfe258f345be8ab7dd641768831d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.585562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.602585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1039/2084] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:34 2022] PUT /identity/v3/projects/bfe63919621c4b3caa724a147b2d1afe/users/2e7554f1186c4f84be02d67169ba3b62/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:34.605869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611726-94e8-4bf1-b7bc-95082e872d20 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.606165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611726-94e8-4bf1-b7bc-95082e872d20 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.606494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d611726-94e8-4bf1-b7bc-95082e872d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.644537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5d611726-94e8-4bf1-b7bc-95082e872d20 None None] MFA Rules not processed for user `7ff0f29401a149bc95b46bcd350d58a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:34.646074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5d611726-94e8-4bf1-b7bc-95082e872d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:34.660729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b389bfe258f345be8ab7dd641768831d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:34.676258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b389bfe258f345be8ab7dd641768831d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:34.678013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b389bfe258f345be8ab7dd641768831d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:34.682006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b389bfe258f345be8ab7dd641768831d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:34.711881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-25ca1ea7-37a8-45d5-aa35-c34152bf0b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b389bfe258f345be8ab7dd641768831d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:34.737339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1046/2085] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:34 2022] DELETE /identity/v3/users/b389bfe258f345be8ab7dd641768831d => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:34.737339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.737621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.737699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.738333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1040/2086] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:34.739999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.740674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.741356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.770592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:34.772162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:34.797695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:34.800444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] MFA Rules not processed for user `2e7554f1186c4f84be02d67169ba3b62`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:34.802773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:34.864588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:34.884094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1041/2087] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:34.886261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.889026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:34.908826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac6abb-1465-415a-8f4f-5487a41efee0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:34.920719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1047/2088] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:34.921621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.923313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:34.932868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:34.933580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:34.933865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:34.934145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:34.935258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:34.937235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:34.979684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1042/2089] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:34 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:34.982501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:34.984935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.027308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0f0b-5d12-4050-a050-e9ce1e33adb0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.104561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ee1b2-d641-4d10-a801-0e7e00f209af admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.113408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.114218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.114650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.115070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.131729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.132693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.133081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.133240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.248748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.248748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.253703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1048/2090] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:35.255841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.257639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.258164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.274139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1043/2091] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:35.287098 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ee0f3-f397-4684-a8a3-6b920948706f service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.295446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.296135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.296415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.296840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.297490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.300980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.314609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.317060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.336875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b51f8a-1fd1-4f6f-8352-44afc83b64fa service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.344929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.346050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.346804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.347800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] PATH_INFO: `/v3/users/2e7554f1186c4f84be02d67169ba3b62` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.349700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e7554f1186c4f84be02d67169ba3b62)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.352327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.358506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1049/2092] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:35 2022] POST /identity/v3/users => generated 301 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:35.362740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.386298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9e942-bdad-43d6-8856-7d8ded05100a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.392436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.393229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.393429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.393653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.394859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.396801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.423989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1050/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:35.424188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.432539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e7554f1186c4f84be02d67169ba3b62'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:35.434535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:35.442730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ea90-d360-45ac-9270-a79d1bf762e5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.453235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.454344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.454736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.455111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] PATH_INFO: `/v3/projects/eccf5d553f7844168f92d09a7253c9d0/users/03295a7835cf4a8fa680a78eded46ca2/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.464936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:35.472041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e7554f1186c4f84be02d67169ba3b62'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:35.474804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e7554f1186c4f84be02d67169ba3b62'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:35.487045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccf5d553f7844168f92d09a7253c9d0, user_id=03295a7835cf4a8fa680a78eded46ca2, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.490723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.521262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e7554f1186c4f84be02d67169ba3b62'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:35.522076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-af891955-25cf-442a-86ba-c2b5daaa3fe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e7554f1186c4f84be02d67169ba3b62'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:35.544210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1044/2094] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:35 2022] DELETE /identity/v3/users/2e7554f1186c4f84be02d67169ba3b62 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:35.548381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.548737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.549085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.557041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1051/2095] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:35 2022] PUT /identity/v3/projects/eccf5d553f7844168f92d09a7253c9d0/users/03295a7835cf4a8fa680a78eded46ca2/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:35.567710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.570407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.593381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:35.594976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.722770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1045/2096] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:35.734123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.735988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.756580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77269614-dbbd-4f8d-b389-e1bfa2a1fa71 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.765029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.766054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.766700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.767305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.768355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.771468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.796086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1052/2097] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:35.797447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:35.809063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb761fc-9a5b-4b59-a3f3-c15b496b5800 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.814594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c7d8d-ea9b-4959-a617-415abec3d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.815329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c7d8d-ea9b-4959-a617-415abec3d674 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.815642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c7d8d-ea9b-4959-a617-415abec3d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.815906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c7d8d-ea9b-4959-a617-415abec3d674 admin admin] PATH_INFO: `/v3/projects/eccf5d553f7844168f92d09a7253c9d0/users/03295a7835cf4a8fa680a78eded46ca2/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.818130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c7d8d-ea9b-4959-a617-415abec3d674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccf5d553f7844168f92d09a7253c9d0, user_id=03295a7835cf4a8fa680a78eded46ca2, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:35.820986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c7d8d-ea9b-4959-a617-415abec3d674 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:35.826591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68dab3b-36f4-4c48-902b-a7a4ce3639f5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:35.844264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1053/2098] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:35 2022] PUT /identity/v3/projects/eccf5d553f7844168f92d09a7253c9d0/users/03295a7835cf4a8fa680a78eded46ca2/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:35.847292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.847590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.848021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:35.879243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] MFA Rules not processed for user `03295a7835cf4a8fa680a78eded46ca2`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:35.880564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:35.932969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:35.933644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:35.935587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:35.936123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.007168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.016811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1054/2099] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:36.018284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.028397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.064054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.066091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.079560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1046/2100] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:36.080497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.081963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.105279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.133289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a2066c-38d9-4166-b163-73bd0ae73aad None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.139253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.140670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.140670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.141208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] PATH_INFO: `/v3/projects/00cf36408f474a75864fca2d52646160` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.143500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=00cf36408f474a75864fca2d52646160)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.147181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.188889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efb6c3-e5d6-47ad-8409-862e686d3652 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.202564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.203268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.203587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.204012 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.223535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.226318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.248015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1047/2101] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:36.250303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00cf36408f474a75864fca2d52646160', 'request_id': 'req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.252113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.258858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.260986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00cf36408f474a75864fca2d52646160', 'request_id': 'req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.272267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00cf36408f474a75864fca2d52646160', 'request_id': 'req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.291732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2b7aba-89cc-4ca2-b281-711d43098e5b service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.300324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] The token cache is being invalidate because project 00cf36408f474a75864fca2d52646160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:36.302402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.305930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.310565 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1055/2102] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:36 2022] DELETE /identity/v3/projects/00cf36408f474a75864fca2d52646160 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:36.314723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.319426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.496067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0510ad4-f5f1-4007-b6f5-6dfbf32dd4fa admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.508232 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.508469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:36.508897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.509305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.509659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.510427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] PATH_INFO: `/v3/users/ef8e4262f32a4b9899d257bdbde12567` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.511338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.511639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] PATH_INFO: `/v3/users/3d8766c7feb842df9990df32a340903a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.513646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d8766c7feb842df9990df32a340903a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.515618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.516134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef8e4262f32a4b9899d257bdbde12567)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:36.518358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:36.654580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d8766c7feb842df9990df32a340903a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.664586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef8e4262f32a4b9899d257bdbde12567'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.671532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d8766c7feb842df9990df32a340903a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.672880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d8766c7feb842df9990df32a340903a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.677952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef8e4262f32a4b9899d257bdbde12567'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.679821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef8e4262f32a4b9899d257bdbde12567'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.681013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef8e4262f32a4b9899d257bdbde12567'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.705689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef8e4262f32a4b9899d257bdbde12567'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.705897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d8766c7feb842df9990df32a340903a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.708980 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-baf6ff02-85d8-4ebc-87be-8f7a6bc8f8a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d8766c7feb842df9990df32a340903a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:36.721283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.728738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1056/2103] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:36 2022] DELETE /identity/v3/users/ef8e4262f32a4b9899d257bdbde12567 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:36.729935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.735938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.745222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1048/2104] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:36 2022] DELETE /identity/v3/users/3d8766c7feb842df9990df32a340903a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:36.749719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:36.750278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:36.750841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:36.753553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:36.790004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:36.792625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:36.910301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d315959-3e6c-4c5e-8b84-d011f0334e6e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:36.978989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1049/2105] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:36.980729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:36.983250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.008546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3759c-c644-4cf4-b6b3-cfaa4e6b3426 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.011155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.011917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.012233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.012508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] PATH_INFO: `/v3/users/7ff0f29401a149bc95b46bcd350d58a5` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.014224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff0f29401a149bc95b46bcd350d58a5)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.018146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.031593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.034739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.035131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.035701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] PATH_INFO: `/v3/projects/bfe63919621c4b3caa724a147b2d1afe` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.038000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe63919621c4b3caa724a147b2d1afe)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.041893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.097892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff0f29401a149bc95b46bcd350d58a5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.107612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff0f29401a149bc95b46bcd350d58a5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.109550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff0f29401a149bc95b46bcd350d58a5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.110515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff0f29401a149bc95b46bcd350d58a5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.128081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff0f29401a149bc95b46bcd350d58a5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.142263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe63919621c4b3caa724a147b2d1afe', 'request_id': 'req-74d6da6f-0f65-4f74-8c90-be75f4f749bc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.156477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1057/2106] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:36 2022] DELETE /identity/v3/users/7ff0f29401a149bc95b46bcd350d58a5 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:37.156477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.156477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.156946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe63919621c4b3caa724a147b2d1afe', 'request_id': 'req-74d6da6f-0f65-4f74-8c90-be75f4f749bc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.172417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe63919621c4b3caa724a147b2d1afe', 'request_id': 'req-74d6da6f-0f65-4f74-8c90-be75f4f749bc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.202538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] The token cache is being invalidate because project bfe63919621c4b3caa724a147b2d1afe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:37.203287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.205690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-74d6da6f-0f65-4f74-8c90-be75f4f749bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:37.210485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1050/2107] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:36 2022] DELETE /identity/v3/projects/bfe63919621c4b3caa724a147b2d1afe => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:37.218875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.222217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.222674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.223140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.289771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc36415-019f-4870-b1e7-e5e72c3beafd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.294042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:37.296585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.299516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.300199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.300482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.300756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.304266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.418093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.420081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb08b491-b840-4409-8a55-5b0a7b2e2664 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.441779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1058/2108] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:37.443643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.443935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.445111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.450360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1051/2109] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:37.459459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.461326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.480086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03909d19-55d3-416a-a079-d2cb2078bc5f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.485192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba95eec-a537-45eb-9f49-a84ba62691d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.486050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba95eec-a537-45eb-9f49-a84ba62691d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.486583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba95eec-a537-45eb-9f49-a84ba62691d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.486966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba95eec-a537-45eb-9f49-a84ba62691d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.498592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:37.499586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba95eec-a537-45eb-9f49-a84ba62691d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.501027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.501485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba95eec-a537-45eb-9f49-a84ba62691d1 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.516651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1052/2110] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:37.523207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1059/2111] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:37.537052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.537609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.538096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.558619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:37.598846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:37.600671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.613521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1053/2112] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:37.621601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.649421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd24cf-5e38-4af4-99fe-41dc96d3b514 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.662747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.663792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.664179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.664455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.665888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:37.665888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.668654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.723864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1060/2113] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:37.732257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.752641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2609b9c1-5042-48bc-8f3e-a4f275d8f14e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.771692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.772509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.773349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.773695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.776254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.778573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:37.795496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.798017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:37.853091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512d29d-e66f-4992-927f-3d1de08b03b6 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:37.876019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:37.879625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:37.880273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:37.885545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] PATH_INFO: `/v3/projects/f42d462052204c5eb37d6e70fa50b9bc` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:37.888396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1054/2114] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:37 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:37.894447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:37.896594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42d462052204c5eb37d6e70fa50b9bc)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:37.901009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.054227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42d462052204c5eb37d6e70fa50b9bc', 'request_id': 'req-406848c5-dd45-4170-85da-cbf8f93e4faa'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.069737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42d462052204c5eb37d6e70fa50b9bc', 'request_id': 'req-406848c5-dd45-4170-85da-cbf8f93e4faa'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.070426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735aa189-3af0-46a5-8b17-5e7dde48574c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.086282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42d462052204c5eb37d6e70fa50b9bc', 'request_id': 'req-406848c5-dd45-4170-85da-cbf8f93e4faa'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.100568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] The token cache is being invalidate because project f42d462052204c5eb37d6e70fa50b9bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:38.100886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.101622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-406848c5-dd45-4170-85da-cbf8f93e4faa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.108011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1061/2115] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:37 2022] DELETE /identity/v3/projects/f42d462052204c5eb37d6e70fa50b9bc => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:38.110876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4d74-8a94-4470-ab62-5612df5cc966 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.111392 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4d74-8a94-4470-ab62-5612df5cc966 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.111857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df4d74-8a94-4470-ab62-5612df5cc966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.139591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f3df4d74-8a94-4470-ab62-5612df5cc966 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:38.152056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f3df4d74-8a94-4470-ab62-5612df5cc966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.189095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.190632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.190632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.190956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.192133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.194918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.242819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:38.258380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1055/2116] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:37 2022] POST /identity/v3/users => generated 287 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:38.258380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.261395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.282057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff781a97-634f-4fa6-931e-d0861791d7ac admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.291667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.292500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.292787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.293113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.294271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.296769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.311378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1062/2117] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:38.325909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.326252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.326460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.337899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1056/2118] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:38.343080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.370505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:38.371649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.374075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575a32c-d92e-45d1-a3a9-cd32fcb49be1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.380084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.380872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.381230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.381888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.382409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.385015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.398808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1063/2119] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:38.400553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.406241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.406848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1057/2120] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:38.407941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.419705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799577e6-5630-4082-91dd-58db2f04d695 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.426436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.427105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.428185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.428528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] PATH_INFO: `/v3/projects/4cfa925f65264051bdf8a76cd7fb5a51` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.430223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cfa925f65264051bdf8a76cd7fb5a51)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.432364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.433530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47cb28-097d-4eda-9ad3-4b332ff87465 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.444096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.445132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.445618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.446087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.447557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:38.448511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.450693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.484954 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1058/2121] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:38.486169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.500473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaffd4-7b20-4ca8-b5d5-f7b7bd0c6bfe admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.507241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cfa925f65264051bdf8a76cd7fb5a51', 'request_id': 'req-d5502540-acd7-4f35-b3a3-8a408edfbca9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.521067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cfa925f65264051bdf8a76cd7fb5a51', 'request_id': 'req-d5502540-acd7-4f35-b3a3-8a408edfbca9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.535550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cfa925f65264051bdf8a76cd7fb5a51', 'request_id': 'req-d5502540-acd7-4f35-b3a3-8a408edfbca9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.540385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:38.567445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] The token cache is being invalidate because project 4cfa925f65264051bdf8a76cd7fb5a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:38.568516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.569491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.573222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1064/2122] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:38 2022] DELETE /identity/v3/projects/4cfa925f65264051bdf8a76cd7fb5a51 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:38.575314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.577523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.589593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.594195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.594570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.594985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] PATH_INFO: `/v3/projects/b4fa0ca7f1fe4be089f885ea5a10d54d/users/f9e51645219e4c73a472b6d7cc353b8a/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.604008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5502540-acd7-4f35-b3a3-8a408edfbca9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.609559 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.610057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.610325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.610596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.611232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.613237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.615883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fa0ca7f1fe4be089f885ea5a10d54d, user_id=f9e51645219e4c73a472b6d7cc353b8a, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.619365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.648347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1059/2123] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:38 2022] PUT /identity/v3/projects/b4fa0ca7f1fe4be089f885ea5a10d54d/users/f9e51645219e4c73a472b6d7cc353b8a/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:38.649436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.651829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.671043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1065/2124] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:38 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:38.676645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.678637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:38.804135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f9a73-f81f-409c-b526-97e87337b981 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.811734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.812958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.812958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.813188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] PATH_INFO: `/v3/projects/d6f64107ddd64ec7a648bd27f0783165` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.814454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6f64107ddd64ec7a648bd27f0783165)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.816466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.817178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93321820-9dc7-4ba0-84d1-6350044ddd14 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:38.824183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:38.825342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.825788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.826267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] PATH_INFO: `/v3/users/0d7a16c35b604b09aa04142f612403a1` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.828475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d7a16c35b604b09aa04142f612403a1)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:38.830992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:38.899239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d7a16c35b604b09aa04142f612403a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.908366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:38.923706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d7a16c35b604b09aa04142f612403a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.924854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6f64107ddd64ec7a648bd27f0783165', 'request_id': 'req-11173c75-f5ad-4af8-ad1e-747c730aa252'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.926777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d7a16c35b604b09aa04142f612403a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.938355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6f64107ddd64ec7a648bd27f0783165', 'request_id': 'req-11173c75-f5ad-4af8-ad1e-747c730aa252'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.950891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6f64107ddd64ec7a648bd27f0783165', 'request_id': 'req-11173c75-f5ad-4af8-ad1e-747c730aa252'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.961242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d7a16c35b604b09aa04142f612403a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.965578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] The token cache is being invalidate because project d6f64107ddd64ec7a648bd27f0783165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:38.965578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.966342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11173c75-f5ad-4af8-ad1e-747c730aa252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.967787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d7a16c35b604b09aa04142f612403a1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:38.967925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1066/2125] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:38 2022] DELETE /identity/v3/projects/d6f64107ddd64ec7a648bd27f0783165 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:38.969110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:38.969399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:38.969665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:38.986700 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1060/2126] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:38 2022] DELETE /identity/v3/users/0d7a16c35b604b09aa04142f612403a1 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:38.988273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:38.989669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.016695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] MFA Rules not processed for user `f9e51645219e4c73a472b6d7cc353b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:39.018474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.060528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:39.104876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71819c4a-734d-43d9-8b14-cf8d9140475d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:39.112061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:39.112995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.113319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.113543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.114396 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:39.117451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:39.127452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1067/2127] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:39.128771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.130565 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.152921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1061/2128] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:38 2022] POST /identity/v3/users => generated 288 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:39.153770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.155848 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.161332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8556681-9446-4840-b4aa-297084a8dc34 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:39.168150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:39.169097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.169582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.170074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] PATH_INFO: `/v3/users/03295a7835cf4a8fa680a78eded46ca2` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.171749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03295a7835cf4a8fa680a78eded46ca2)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:39.174112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:39.249968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2395511-c7aa-43cb-93be-7cdb028a0116 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:39.256334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:39.257515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.258190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.258484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.271657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:39.273282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:39.277456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03295a7835cf4a8fa680a78eded46ca2'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:39.285392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1062/2129] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:39.286797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.288494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.289828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03295a7835cf4a8fa680a78eded46ca2'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:39.290858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03295a7835cf4a8fa680a78eded46ca2'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:39.292312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03295a7835cf4a8fa680a78eded46ca2'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:39.311597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03295a7835cf4a8fa680a78eded46ca2'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:39.316064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b5e73-f6b6-40e6-abea-cecf573c45d4 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:39.326966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:39.327721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.328038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.328308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.328966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:39.330599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:39.341202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1068/2130] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:39 2022] DELETE /identity/v3/users/03295a7835cf4a8fa680a78eded46ca2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:39.349307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1063/2131] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:39.352872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.355130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.440893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:39.520252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6496-b0a9-4cb8-9faa-b8489a0e5a08 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:39.529164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f0b37-18b3-4c3c-a290-1a3df1e72930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:39.530088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0b37-18b3-4c3c-a290-1a3df1e72930 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.530513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0b37-18b3-4c3c-a290-1a3df1e72930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.530965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f0b37-18b3-4c3c-a290-1a3df1e72930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.532385 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f0b37-18b3-4c3c-a290-1a3df1e72930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:39.535629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f0b37-18b3-4c3c-a290-1a3df1e72930 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:39.556739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1069/2132] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:39.557559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.573420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89503b6e-1582-414f-91ff-d7bd8f91eea5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:39.581554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:39.582605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.583375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.583375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] PATH_INFO: `/v3/projects/a7ca967e83f94ab78df620a108481a8e/users/4f127e4699c441dea0118c7e64304be8/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.615028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7ca967e83f94ab78df620a108481a8e, user_id=4f127e4699c441dea0118c7e64304be8, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:39.619746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:39.645411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1064/2133] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:39 2022] PUT /identity/v3/projects/a7ca967e83f94ab78df620a108481a8e/users/4f127e4699c441dea0118c7e64304be8/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:39.657709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:39.657709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:39.657709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:39.697053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] MFA Rules not processed for user `4f127e4699c441dea0118c7e64304be8`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:39.699332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.882299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1070/2134] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:39.883591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.886426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:39.896765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:39.899299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.072481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ceec4a-94f8-4799-908f-30ae8b9a5483 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.077444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.077444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.077655 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.077894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] PATH_INFO: `/v3/projects/56a725160f2345f89e45395a3197f612` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.079878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89413bdb-9f86-4c2a-961b-5709d7c17a8a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.083033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a725160f2345f89e45395a3197f612)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.086002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7eda4-c3c9-411a-bc56-e2833c27b7a6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.087201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7eda4-c3c9-411a-bc56-e2833c27b7a6 service glance] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.087514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7eda4-c3c9-411a-bc56-e2833c27b7a6 service glance] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.087824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7eda4-c3c9-411a-bc56-e2833c27b7a6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.089397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.098918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7eda4-c3c9-411a-bc56-e2833c27b7a6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.101095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7eda4-c3c9-411a-bc56-e2833c27b7a6 service glance] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.113571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1071/2135] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:40.163736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.178335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a725160f2345f89e45395a3197f612', 'request_id': 'req-0d833fc5-5208-4dc7-be90-6729941a21bc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.187896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a725160f2345f89e45395a3197f612', 'request_id': 'req-0d833fc5-5208-4dc7-be90-6729941a21bc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.200162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a725160f2345f89e45395a3197f612', 'request_id': 'req-0d833fc5-5208-4dc7-be90-6729941a21bc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.222906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] The token cache is being invalidate because project 56a725160f2345f89e45395a3197f612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:40.223356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.228620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.234551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1065/2136] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:39 2022] DELETE /identity/v3/projects/56a725160f2345f89e45395a3197f612 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:40.239876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402496-3300-455d-b8df-b4ff12faf05a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.240490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402496-3300-455d-b8df-b4ff12faf05a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.240970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82402496-3300-455d-b8df-b4ff12faf05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.257780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.260990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.287633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-82402496-3300-455d-b8df-b4ff12faf05a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:40.289824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-82402496-3300-455d-b8df-b4ff12faf05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.364048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.397146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d833fc5-5208-4dc7-be90-6729941a21bc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.403541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.404224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.404505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.404790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] PATH_INFO: `/v3/projects/eccf5d553f7844168f92d09a7253c9d0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.405942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccf5d553f7844168f92d09a7253c9d0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.407872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.418596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1072/2137] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:40.420052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.420345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.420616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.465359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:40.466614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.494901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccf5d553f7844168f92d09a7253c9d0', 'request_id': 'req-446c2c74-db02-472a-8572-6c96f799b3b8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.504410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccf5d553f7844168f92d09a7253c9d0', 'request_id': 'req-446c2c74-db02-472a-8572-6c96f799b3b8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.514619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccf5d553f7844168f92d09a7253c9d0', 'request_id': 'req-446c2c74-db02-472a-8572-6c96f799b3b8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.539449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] The token cache is being invalidate because project eccf5d553f7844168f92d09a7253c9d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:40.540568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.543910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-446c2c74-db02-472a-8572-6c96f799b3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:40.549225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1066/2138] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:40 2022] DELETE /identity/v3/projects/eccf5d553f7844168f92d09a7253c9d0 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:40.550836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2955e-589b-4517-8fd7-03b1a3aa5afe None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.551199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2955e-589b-4517-8fd7-03b1a3aa5afe None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.551545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2955e-589b-4517-8fd7-03b1a3aa5afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.569269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1073/2139] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:40.575642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.590601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820661c7-88e5-4525-a8d1-0836ff6cc7d7 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.591914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5ae2955e-589b-4517-8fd7-03b1a3aa5afe None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:40.593973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5ae2955e-589b-4517-8fd7-03b1a3aa5afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.610315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1067/2140] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:40.617451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.617451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.617451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.617451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.617838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:40.617838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.620261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.620716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.621065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.621284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.644695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1074/2141] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:40.650819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:40.651514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.652120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:40.660467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1068/2142] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:40.664943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.672868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6538d7-fb80-421f-8600-823856220e79 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.676200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685fc6b-c404-47aa-9232-4db5f9fb7921 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.682631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.683549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.683685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.684171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.684498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.684772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.685070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.685444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.685948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:40.686289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.686596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.689006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.689348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.707420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1069/2143] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:17:40.711714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.725890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89991aac-01f0-49d1-8174-69765eadd83c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.735425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:40.736718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:40.737195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:40.737757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:40.739184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:40.746367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1075/2144] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:40.746561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:40.748055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.786820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1070/2145] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:40.787891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:40.816895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:40.901131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2979b19-1624-4a59-92a9-901b652d27d2 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:40.989808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d199bc9-181e-4214-a729-b6d02ca8fa3d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.004426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ab16d-0b07-4bcd-a288-af25b5b7d999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.005286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab16d-0b07-4bcd-a288-af25b5b7d999 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.005568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab16d-0b07-4bcd-a288-af25b5b7d999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.005844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ab16d-0b07-4bcd-a288-af25b5b7d999 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.006664 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ab16d-0b07-4bcd-a288-af25b5b7d999 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.008995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64ab16d-0b07-4bcd-a288-af25b5b7d999 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.045471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1071/2146] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:41.049516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.051229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.051511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.063936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.078322 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] MFA Rules not processed for user `f9e51645219e4c73a472b6d7cc353b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:41.078800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.079693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.080136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.080421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:41.080852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.081604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.084754 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.113088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1076/2147] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:40 2022] POST /identity/v3/users => generated 290 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:41.114433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.126843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e43c2-8634-4dc5-bfe5-2285cecffec9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.133023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.134292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.134292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.134766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.135536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.137772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.153124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1077/2148] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:41.157258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.179377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b69f96-3058-4df6-ab1b-f6c6a2456274 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.189577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1072/2149] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:41.189577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.197042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.198652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.199022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.199344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.200400 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.202591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.209204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4fd80f-c350-4593-8542-9478706263e6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.216510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.217309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.217782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.218191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.219003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.220777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.222329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1078/2150] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:41.226382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.240070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f87a56-aa87-472d-8941-bc873d7f94bf admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.240293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1073/2151] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:41.243210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.243933 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.244141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.244427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.244798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.245593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.247310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.258678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320612a-9376-4f32-86c0-d1d4bbff82a9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.265037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53d344e-818a-4da2-99bb-e2db21a09670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.265982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d344e-818a-4da2-99bb-e2db21a09670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.266570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d344e-818a-4da2-99bb-e2db21a09670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.269845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d344e-818a-4da2-99bb-e2db21a09670 admin admin] PATH_INFO: `/v3/projects/4c7dc2e4e6b84595bb449dcdb2026bd6/users/f062d211cde04a33b4e4bcd0fc76cfdc/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.270452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1079/2152] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:41.271555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.284553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96a53b-f06e-4b7a-b7ad-4de089434f14 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.286542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d344e-818a-4da2-99bb-e2db21a09670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c7dc2e4e6b84595bb449dcdb2026bd6, user_id=f062d211cde04a33b4e4bcd0fc76cfdc, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.289708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53d344e-818a-4da2-99bb-e2db21a09670 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.291345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83856662-d353-4dc5-b6aa-88350b019198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.292173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83856662-d353-4dc5-b6aa-88350b019198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.292557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83856662-d353-4dc5-b6aa-88350b019198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.292899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83856662-d353-4dc5-b6aa-88350b019198 admin admin] PATH_INFO: `/v3/projects/fe3af330c0e54ecfb87aebed94246b03/users/7c85cd20be8f4521b74dad7198ad5043/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.311342 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1074/2153] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:41 2022] PUT /identity/v3/projects/4c7dc2e4e6b84595bb449dcdb2026bd6/users/f062d211cde04a33b4e4bcd0fc76cfdc/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:41.316002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83856662-d353-4dc5-b6aa-88350b019198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3af330c0e54ecfb87aebed94246b03, user_id=7c85cd20be8f4521b74dad7198ad5043, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.321072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83856662-d353-4dc5-b6aa-88350b019198 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.332233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.332928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.333680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.343842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1080/2154] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:41 2022] PUT /identity/v3/projects/fe3af330c0e54ecfb87aebed94246b03/users/7c85cd20be8f4521b74dad7198ad5043/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:41.355495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.356020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.356365 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.384041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] MFA Rules not processed for user `f062d211cde04a33b4e4bcd0fc76cfdc`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:41.385594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:41.401055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] MFA Rules not processed for user `7c85cd20be8f4521b74dad7198ad5043`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:41.402979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:41.485360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.495879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1075/2155] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:41.509039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.512039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:41.524911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1081/2156] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:41.530832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.603331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de459-d455-411b-a779-58ddb454a0f1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.607447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.608096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.608501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.608789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.619584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.621159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.621922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4287e5-68e4-4de8-8543-73b792bb9f32 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.628573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.629260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.629566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.630703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.630703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.633277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.638430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1076/2157] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:41.671107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:41.679582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.696435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f8fb2-7b85-4781-bf1e-06abd12d0a83 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.705735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1082/2158] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:41 2022] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:41.706709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.796067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.797718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.803123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a35151-9ae8-4d55-94c2-a917396fe041 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.807796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.808477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.808810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.809141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.809962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.812029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.812873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.816027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] PATH_INFO: `/v3/users/f062d211cde04a33b4e4bcd0fc76cfdc` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.818540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f062d211cde04a33b4e4bcd0fc76cfdc)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.822878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.846870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1083/2159] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:41 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:41.855837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.868007 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4343cfb-0a9b-409d-90e6-af073abd72e0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.874259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.875150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.875577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.875927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.876721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.878590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:41.897236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1084/2160] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:41.901285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:41.912453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bc3e6-d10f-46cf-a9ff-6e4786241831 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:41.927603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:41.929529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:41.930017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:41.930498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] PATH_INFO: `/v3/projects/5d6ac5f9c9684d9099b557a2b68d21d8/users/b9fb979e73a6435283a22498b4d48eb4/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:41.942467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f062d211cde04a33b4e4bcd0fc76cfdc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:41.958389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f062d211cde04a33b4e4bcd0fc76cfdc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:41.959393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f062d211cde04a33b4e4bcd0fc76cfdc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:41.981626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6ac5f9c9684d9099b557a2b68d21d8, user_id=b9fb979e73a6435283a22498b4d48eb4, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:41.986967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f062d211cde04a33b4e4bcd0fc76cfdc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:41.992362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0d97c222-3bda-491d-a585-31520aa8677b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f062d211cde04a33b4e4bcd0fc76cfdc'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:41.992883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.034798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1085/2161] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:41 2022] PUT /identity/v3/projects/5d6ac5f9c9684d9099b557a2b68d21d8/users/b9fb979e73a6435283a22498b4d48eb4/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:42.035870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.037449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1077/2162] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:41 2022] DELETE /identity/v3/users/f062d211cde04a33b4e4bcd0fc76cfdc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:42.046330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:42.051925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.052290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.052531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.115334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:42.115334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:42.141120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:42.169539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306b78a-3e5c-4217-909f-d2e493599d25 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.249063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1078/2163] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:42.282251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.284170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:42.339807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.340649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.340937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.341208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.341877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.344620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.346240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:42.358119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1086/2164] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:42.364633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.379312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62289260-aa53-4b48-8fc6-fd935f20af2d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.393443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92d41c-790c-41b0-9038-a57bd870b627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.393443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d41c-790c-41b0-9038-a57bd870b627 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.393443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d41c-790c-41b0-9038-a57bd870b627 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.393443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92d41c-790c-41b0-9038-a57bd870b627 admin admin] PATH_INFO: `/v3/projects/5d6ac5f9c9684d9099b557a2b68d21d8/users/b9fb979e73a6435283a22498b4d48eb4/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.393935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92d41c-790c-41b0-9038-a57bd870b627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d6ac5f9c9684d9099b557a2b68d21d8, user_id=b9fb979e73a6435283a22498b4d48eb4, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.396812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92d41c-790c-41b0-9038-a57bd870b627 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.424798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1087/2165] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:42 2022] PUT /identity/v3/projects/5d6ac5f9c9684d9099b557a2b68d21d8/users/b9fb979e73a6435283a22498b4d48eb4/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:42.426633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.427142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.427481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.428177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd9081-94ff-4c3a-91ad-2c9cbcba4643 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.473641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] MFA Rules not processed for user `b9fb979e73a6435283a22498b4d48eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:42.475873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:42.534736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.535422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.535698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.535994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.612416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1088/2166] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:42 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:42.626255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:42.632970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:42.693865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.695490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.739685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1079/2167] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:42.796903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e860dccd-c549-4e0f-88f7-a5dd4af77b9a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:42.803584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:42.804527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:42.804905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:42.805272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:42.847624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:42.868606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:42.921833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1089/2168] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:43.055335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:43.107421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35199e6e-98cc-4714-a7f9-f985bfbc5be0 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:43.113687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:43.114317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.116896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.117226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.121895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:43.190234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:43.280674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:43.283543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbd297a-7f19-497a-9243-b315b85dde49 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:43.314761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1080/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:43 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:43.598591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:43.601418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:43.633103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4423a-ad59-414f-81b0-70ea64471173 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:43.639431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:43.645875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.646618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.647203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] PATH_INFO: `/v3/projects/4c7dc2e4e6b84595bb449dcdb2026bd6` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.649759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c7dc2e4e6b84595bb449dcdb2026bd6)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:43.654664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:43.728981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c7dc2e4e6b84595bb449dcdb2026bd6', 'request_id': 'req-7733a7b0-3617-4774-bfc1-6ffa73a0580f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:43.745148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c7dc2e4e6b84595bb449dcdb2026bd6', 'request_id': 'req-7733a7b0-3617-4774-bfc1-6ffa73a0580f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:43.760117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c7dc2e4e6b84595bb449dcdb2026bd6', 'request_id': 'req-7733a7b0-3617-4774-bfc1-6ffa73a0580f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:43.768417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:43.799582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] The token cache is being invalidate because project 4c7dc2e4e6b84595bb449dcdb2026bd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:43.800169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:43.801597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-7733a7b0-3617-4774-bfc1-6ffa73a0580f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:43.807724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1090/2170] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:43 2022] DELETE /identity/v3/projects/4c7dc2e4e6b84595bb449dcdb2026bd6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:43.810246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.810561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.810799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:43.843800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:43.846360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:43.996862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1081/2171] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:43.997892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:43.998183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:43.998459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.031762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:44.033060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:44.057661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1091/2172] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:17:44.061864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.084192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fc35bf-e53e-441d-ae13-9ee24eab9b46 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.110862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.111672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.111976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.112244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.112930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:44.115536 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.122813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.165320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1082/2173] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:44.171660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.187870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff9176f-74d1-4be7-896a-6434ea78e778 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.195832 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.196809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.197716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.198323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.198981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.201555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.292546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1092/2174] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:44 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:44.293714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.304833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb468255-cb9b-4a41-994f-e28574b0ac7f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.373016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.373681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.374021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.374321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.374949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.377017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.421724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1083/2175] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:44 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:44.424417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.446233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b36210-0eeb-4cf7-9cda-6708f2f7dc56 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.465021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.465968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.466474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.466951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.467818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.470983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.495718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1093/2176] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:44.496747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.516549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b31a8-3ac6-42ea-a84c-d47254aedb6b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.560469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4392f-4555-44f7-b356-19d36aa33868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.561386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4392f-4555-44f7-b356-19d36aa33868 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.565713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4392f-4555-44f7-b356-19d36aa33868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.567638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4392f-4555-44f7-b356-19d36aa33868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.567638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4392f-4555-44f7-b356-19d36aa33868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.568570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca4392f-4555-44f7-b356-19d36aa33868 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.600734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1084/2177] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:44 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:44.601682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:44.673776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102eb17c-7bba-4a4c-a5bc-0c7db961e960 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:44.690113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:44.690990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.691123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.691311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] PATH_INFO: `/v3/projects/4d63c7f05cb640ae8858d2c4f0a611fd/users/696de820957e4c87a04c2f42035a7626/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.740070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d63c7f05cb640ae8858d2c4f0a611fd, user_id=696de820957e4c87a04c2f42035a7626, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:44.747077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:44.820497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1094/2178] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:44 2022] PUT /identity/v3/projects/4d63c7f05cb640ae8858d2c4f0a611fd/users/696de820957e4c87a04c2f42035a7626/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:44.826316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:44.826605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:44.827052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:44.888175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] MFA Rules not processed for user `696de820957e4c87a04c2f42035a7626`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:44.889862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:44.952101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:45.057385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1085/2179] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:45.065629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.176210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409b9ed-6b5a-42e6-8910-7536ce0c9302 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.184701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.185668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.186133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.186578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.187397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.190051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.246727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1095/2180] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:45.252085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.269883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45670be-58a8-45a3-b38e-f02ec9fc768a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.415602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.416527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.416797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.417006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.418027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.419642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.445534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1086/2181] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:45 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:45.450632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.461268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e52def-25ae-44da-b801-392cd0fca1ea admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.466969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.467745 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.468045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.468319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.469267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.470635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.492584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1096/2182] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:45.497333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.530437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b4804-3388-4d4f-9a0b-324d7455e2ec admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.541783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b8d7e-e8e0-4f58-982a-e8ac371d0bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.542397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8d7e-e8e0-4f58-982a-e8ac371d0bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.542680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8d7e-e8e0-4f58-982a-e8ac371d0bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.542950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b8d7e-e8e0-4f58-982a-e8ac371d0bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.543831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8d7e-e8e0-4f58-982a-e8ac371d0bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.545510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b8d7e-e8e0-4f58-982a-e8ac371d0bd3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.566216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1087/2183] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:45.570041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.582299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea5d2a-3761-4d43-8596-a4d92a232b4e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:45.589959 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:45.590667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.590950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.591228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] PATH_INFO: `/v3/projects/b24dbc1ce7b540bc8341f1b279e0c453/users/3091625f37fe4cd4bf012998e66a1cd2/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.616994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24dbc1ce7b540bc8341f1b279e0c453, user_id=3091625f37fe4cd4bf012998e66a1cd2, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:45.621257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:45.648082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1097/2184] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:45 2022] PUT /identity/v3/projects/b24dbc1ce7b540bc8341f1b279e0c453/users/3091625f37fe4cd4bf012998e66a1cd2/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:45.664679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:45.664679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:45.664679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:45.705183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] MFA Rules not processed for user `3091625f37fe4cd4bf012998e66a1cd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:45.706720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:45.836020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1088/2185] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:45.840289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:45.975790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:46.029164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2f759-09e8-4053-8173-001c34ac8b60 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.048001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.048963 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.049423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.049855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.050769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.052961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.153532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1098/2186] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:45 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:46.154918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.179351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9194a4-5141-4cb4-ac11-01cb3b0e80d6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.225186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:46.361673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.362333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.362571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.371096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.373466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.380555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.456219 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.463053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1089/2187] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:46 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:46.498118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a98777-af40-4b79-a495-a8616f36f603 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.525578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.527587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.535126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.535647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.536705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.538852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.563685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1099/2188] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:46.568824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.587785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388edb0-db5f-48ce-93ce-5427bdf1c2b9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.599246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.601586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.603486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.604721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] PATH_INFO: `/v3/projects/7d694d3d22f3431199d9d0aebbbe45e6/users/60b42d617fc74c079f5d404cbfdbe2af/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.633858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d694d3d22f3431199d9d0aebbbe45e6, user_id=60b42d617fc74c079f5d404cbfdbe2af, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.638284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.667802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1090/2189] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:46 2022] PUT /identity/v3/projects/7d694d3d22f3431199d9d0aebbbe45e6/users/60b42d617fc74c079f5d404cbfdbe2af/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:46.675503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.698407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2959ca6-ef7b-4341-b108-7dd0804a27ca admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.812821 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ba011-8e86-41b4-ac7c-d1ed9343d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.813970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ba011-8e86-41b4-ac7c-d1ed9343d780 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.815222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ba011-8e86-41b4-ac7c-d1ed9343d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.815222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ba011-8e86-41b4-ac7c-d1ed9343d780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.816131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ba011-8e86-41b4-ac7c-d1ed9343d780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.818446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ba011-8e86-41b4-ac7c-d1ed9343d780 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.845436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1100/2190] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:46.847403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:46.880626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06cab8b-81a0-4087-9fc8-43cc4f4ab255 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:46.886504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:46.887541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.888363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.889132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] PATH_INFO: `/v3/projects/7d694d3d22f3431199d9d0aebbbe45e6/users/60b42d617fc74c079f5d404cbfdbe2af/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:46.893645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d694d3d22f3431199d9d0aebbbe45e6, user_id=60b42d617fc74c079f5d404cbfdbe2af, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:46.898006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:46.926912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1091/2191] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:46 2022] PUT /identity/v3/projects/7d694d3d22f3431199d9d0aebbbe45e6/users/60b42d617fc74c079f5d404cbfdbe2af/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:46.940443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:46.941471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:46.942446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.019998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] MFA Rules not processed for user `60b42d617fc74c079f5d404cbfdbe2af`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:47.023017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:47.174663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1101/2192] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:47.201508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.205454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:47.400077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9eba2d-53c1-42c2-bbda-861c6b4fe2b9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:47.405364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:47.406402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:47.407038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:47.407461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:47.517626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:47.521593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:47.549787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1092/2193] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:47.813885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:47.816272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:47.963530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:48.081723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b08a85-a50d-414d-8dab-b425384c89c8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:48.101201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:48.101201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:48.101201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:48.101201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] PATH_INFO: `/v3/users/57cc2451917d4ecea594e92458980f11` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:48.101473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57cc2451917d4ecea594e92458980f11)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:48.101473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:48.194345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57cc2451917d4ecea594e92458980f11'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.209903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57cc2451917d4ecea594e92458980f11'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.210542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57cc2451917d4ecea594e92458980f11'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.211450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57cc2451917d4ecea594e92458980f11'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.230179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-67590edb-c49d-40b8-8bbb-dff90c491a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57cc2451917d4ecea594e92458980f11'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.255333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1102/2194] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:47 2022] DELETE /identity/v3/users/57cc2451917d4ecea594e92458980f11 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:48.705605 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:48.729439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b65b0-f3cc-448b-a5ce-e93bfe56ae39 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:48.810516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:48.849706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:48.850689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:48.851059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:48.851361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] PATH_INFO: `/v3/projects/110e38293e9d4e2f82f384406d453a74` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:48.852753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] RBAC: Authorizing `identity:delete_project(project_id=110e38293e9d4e2f82f384406d453a74)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:48.855418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:48.932707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110e38293e9d4e2f82f384406d453a74', 'request_id': 'req-c59216ed-3bcb-48b5-8ee3-36714902f03f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.943669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110e38293e9d4e2f82f384406d453a74', 'request_id': 'req-c59216ed-3bcb-48b5-8ee3-36714902f03f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.956812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110e38293e9d4e2f82f384406d453a74', 'request_id': 'req-c59216ed-3bcb-48b5-8ee3-36714902f03f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.976209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] The token cache is being invalidate because project 110e38293e9d4e2f82f384406d453a74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:48.976636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.977612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c59216ed-3bcb-48b5-8ee3-36714902f03f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:48.980088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1093/2195] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:48 2022] DELETE /identity/v3/projects/110e38293e9d4e2f82f384406d453a74 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:48.986037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:48.986600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:48.986600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.007278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:49.008549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:49.089460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1103/2196] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:49.097261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.097547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.097838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.120020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:49.121118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:49.131018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1094/2197] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:49.135055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.154172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079787b-cebd-494c-914d-f0ca3da31a17 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.157644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.158283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.158584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.158856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.159504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:49.159806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.163979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.176867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1104/2198] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:49.181413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.192653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42a382-dae1-4326-93b2-02373f96e37e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.197961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.198669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.198956 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.199230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.200165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.202257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.243786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1095/2199] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:49 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:49.244947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.257115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c5502-868d-4013-bd9b-43c9aa0d69e4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.274636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.276882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:49.314409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:49.336464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.337071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.337870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380aac6-a9f9-49e2-861a-ebe08aebcd15 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.338009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.338169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.338854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.340957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.341713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.342299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.342574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.342837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.348271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:49.368925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1105/2200] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:49 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:17:49.373224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.383054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78180167-a612-4089-a62b-6dcf112666f0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.388003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32192452-d139-4adc-817f-87621479f601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.388600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32192452-d139-4adc-817f-87621479f601 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.388917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32192452-d139-4adc-817f-87621479f601 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.389201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32192452-d139-4adc-817f-87621479f601 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.389852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32192452-d139-4adc-817f-87621479f601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.391470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32192452-d139-4adc-817f-87621479f601 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.404925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1106/2201] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:49.408889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32192452-d139-4adc-817f-87621479f601 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.409033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:49.421728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32192452-d139-4adc-817f-87621479f601 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.422067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.423590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.426328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17d6ce-878c-4190-89f1-46d9bc1f0b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.427034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17d6ce-878c-4190-89f1-46d9bc1f0b4c admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.427204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17d6ce-878c-4190-89f1-46d9bc1f0b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.427487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17d6ce-878c-4190-89f1-46d9bc1f0b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.428189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17d6ce-878c-4190-89f1-46d9bc1f0b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.430334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17d6ce-878c-4190-89f1-46d9bc1f0b4c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.435148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1096/2202] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:49.442575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1107/2203] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:17:49.447362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.458334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4461a12-1a54-4729-8217-9315a9569b6a service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.462916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.463579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.463859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.464253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] PATH_INFO: `/v3/projects/7cc6652689c342208bf85021675f27e1/users/cccdcfdf39404cf484e7614254730e6d/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.480838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc6652689c342208bf85021675f27e1, user_id=cccdcfdf39404cf484e7614254730e6d, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.483634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.498261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1097/2204] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:49 2022] PUT /identity/v3/projects/7cc6652689c342208bf85021675f27e1/users/cccdcfdf39404cf484e7614254730e6d/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:49.503868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.504228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.504629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.526841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:49.528110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:49.595199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1108/2205] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:49.605744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:49.607844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:49.671560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3258759b-a359-4c9e-aaaa-560b3b102bb8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:49.676258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:49.676917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:49.677281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:49.677455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:49.689067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:49.691128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:49.703870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1098/2206] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:50.324025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:50.417345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2724de4a-bc98-46c2-9856-6ce18b27715c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:50.421200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:50.421808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:50.422088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:50.422658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:50.425433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:50.503808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:50.505350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b211c42-1b79-4381-85be-dd32e1a5c807 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:50.511792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:50.517804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1109/2207] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:50 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:51.689609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:51.691023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:51.727823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed9b28-dccf-4510-8e0d-68e0a08a5e46 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:51.740723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:51.741567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:51.741999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:51.742418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] PATH_INFO: `/v3/users/7c85cd20be8f4521b74dad7198ad5043` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:51.745146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c85cd20be8f4521b74dad7198ad5043)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:51.747121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:51.851023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c85cd20be8f4521b74dad7198ad5043'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:51.864440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c85cd20be8f4521b74dad7198ad5043'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:51.866988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c85cd20be8f4521b74dad7198ad5043'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:51.907703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c85cd20be8f4521b74dad7198ad5043'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:51.909610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c85cd20be8f4521b74dad7198ad5043'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:51.934669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1099/2208] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:51 2022] DELETE /identity/v3/users/7c85cd20be8f4521b74dad7198ad5043 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:51.939643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:51.947492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:51.951703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:52.001861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:52.003735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:52.138161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1110/2209] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:52.149579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:52.151762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:52.225620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:52.244161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04692bbb-fbf5-41c1-9a8a-7dbef54216df admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:52.249920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:52.250647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:52.251078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:52.251456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:52.270888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:52.273689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:52.296199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1100/2210] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:52.678240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:52.679795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:52.705378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98827485-c71c-4336-969f-f709aa0d4eb5 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:52.716965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:52.718550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:52.719504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:52.720352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] PATH_INFO: `/v3/projects/fe3af330c0e54ecfb87aebed94246b03` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:52.723577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3af330c0e54ecfb87aebed94246b03)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:52.726612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:52.797336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3af330c0e54ecfb87aebed94246b03', 'request_id': 'req-1e80e45f-0353-4cd8-89a3-7b871b0a813c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:52.807011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3af330c0e54ecfb87aebed94246b03', 'request_id': 'req-1e80e45f-0353-4cd8-89a3-7b871b0a813c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:52.818100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3af330c0e54ecfb87aebed94246b03', 'request_id': 'req-1e80e45f-0353-4cd8-89a3-7b871b0a813c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:52.842782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] The token cache is being invalidate because project fe3af330c0e54ecfb87aebed94246b03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:52.843459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:52.844016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:52.855602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:52.865045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1111/2211] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:52 2022] DELETE /identity/v3/projects/fe3af330c0e54ecfb87aebed94246b03 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:52.868594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b5c8f7-65f7-4016-b2fe-264382bee739 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:52.980424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:52.981168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:52.981552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:52.981896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] PATH_INFO: `/v3/users/b9fb979e73a6435283a22498b4d48eb4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:52.983243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9fb979e73a6435283a22498b4d48eb4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:52.985490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:53.058861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9fb979e73a6435283a22498b4d48eb4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:53.075007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9fb979e73a6435283a22498b4d48eb4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:53.076248 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9fb979e73a6435283a22498b4d48eb4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:53.106783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9fb979e73a6435283a22498b4d48eb4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:53.107543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9fb979e73a6435283a22498b4d48eb4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:53.133726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1101/2212] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:52 2022] DELETE /identity/v3/users/b9fb979e73a6435283a22498b4d48eb4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:53.848099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:53.850097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:53.863936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:53.866150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:53.885082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e45f-0353-4cd8-89a3-7b871b0a813c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.011720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f04055-3a40-4135-aa88-3e6fe3d914b4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.021622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.022253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.022532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.022811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.025284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:54.029972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.031619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.032527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.033001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] PATH_INFO: `/v3/projects/5d6ac5f9c9684d9099b557a2b68d21d8` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.039495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d6ac5f9c9684d9099b557a2b68d21d8)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.043742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.078043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:54.093616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:54.115698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d6ac5f9c9684d9099b557a2b68d21d8', 'request_id': 'req-11ff763f-5b36-46d8-a901-dddcbc2c56c0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:54.123844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d6ac5f9c9684d9099b557a2b68d21d8', 'request_id': 'req-11ff763f-5b36-46d8-a901-dddcbc2c56c0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:54.135116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d6ac5f9c9684d9099b557a2b68d21d8', 'request_id': 'req-11ff763f-5b36-46d8-a901-dddcbc2c56c0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:54.153355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] The token cache is being invalidate because project 5d6ac5f9c9684d9099b557a2b68d21d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:54.154563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:54.155609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-11ff763f-5b36-46d8-a901-dddcbc2c56c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:54.161791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1112/2213] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:53 2022] DELETE /identity/v3/projects/5d6ac5f9c9684d9099b557a2b68d21d8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:54.163691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.164428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.166517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.199266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:54.201247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:54.218106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.219755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbf338a-c256-4b42-ad6e-1699b34746f1 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.253477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1102/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:54.402820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1113/2215] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:54.423550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.423550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.423550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.445894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:54.448029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:54.459408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1103/2216] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:54.466596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.495490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ae90a8-1be1-4aa2-b78d-e706506d74cc None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.506901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.509931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.511025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.511304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.513338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:17:54.514639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.519496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.562778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1114/2217] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:17:54.573755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.588986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81841e-acf7-40b7-923a-4095917b7b4b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.595668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.596345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.596622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.597188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.597526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.599844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.656993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1104/2218] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:54 2022] POST /identity/v3/projects => generated 387 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:54.658664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.670681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608539c0-3837-4117-be0f-99b8943a3441 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.753709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.753709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.753709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.755372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.756040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.758056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.787987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1115/2219] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:54 2022] POST /identity/v3/users => generated 294 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:54.790764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.803559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76fd08-6f89-4200-8f01-db38f0e01521 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.810204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.810863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.811195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.811411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.812107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.814049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.825971 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1105/2220] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:54.830190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.855625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be15087a-1f3f-449f-8213-2ee7f80da0b0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.864656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceccef56-3efc-47de-8083-06e950c01a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.865644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccef56-3efc-47de-8083-06e950c01a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.866154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccef56-3efc-47de-8083-06e950c01a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.866627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceccef56-3efc-47de-8083-06e950c01a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.867480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccef56-3efc-47de-8083-06e950c01a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.869433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceccef56-3efc-47de-8083-06e950c01a0e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:54.883372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1116/2221] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:54.888594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:54.900422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd15d93-af4f-472f-8227-4226cfe9d015 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:54.906560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:54.908070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:54.908446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:54.908817 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] PATH_INFO: `/v3/projects/51c770ad8fb74331a718a330dc66a5e7/users/41c144d82a744e2ea7b9cc35a68bf445/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:54.965895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c770ad8fb74331a718a330dc66a5e7, user_id=41c144d82a744e2ea7b9cc35a68bf445, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:54.969533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:55.005678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1106/2222] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:54 2022] PUT /identity/v3/projects/51c770ad8fb74331a718a330dc66a5e7/users/41c144d82a744e2ea7b9cc35a68bf445/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:55.016727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.017012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.017290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.056279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] MFA Rules not processed for user `41c144d82a744e2ea7b9cc35a68bf445`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:55.059637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:55.075608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:55.168579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1117/2223] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:55.182453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.323021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b067e43-5526-42c8-a3f4-1a9f5e61dc02 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:55.328776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:55.329585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.330175 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.330597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.334613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:55.338417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:55.357906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.357906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:55.381045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5429419f-09d7-49f0-9031-3eae2413e3a3 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:55.390154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:55.391241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.391573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.391846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] PATH_INFO: `/v3/users/696de820957e4c87a04c2f42035a7626` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.395735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=696de820957e4c87a04c2f42035a7626)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:55.397789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:55.429054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1107/2224] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:17:55 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:55.435557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.536414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:55.539897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696de820957e4c87a04c2f42035a7626'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:55.559490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696de820957e4c87a04c2f42035a7626'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:55.560343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696de820957e4c87a04c2f42035a7626'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:55.561015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696de820957e4c87a04c2f42035a7626'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:55.593904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f84735-b256-4173-914d-259acbbcfb1c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:55.595229 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8782cd3b-1d44-4fe5-92dc-9a0eaf630418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696de820957e4c87a04c2f42035a7626'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:55.600406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:55.601176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.601662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.602034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.603844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:55.607662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:55.630804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1118/2225] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:55 2022] DELETE /identity/v3/users/696de820957e4c87a04c2f42035a7626 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:55.632349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.636139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.636482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.642719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1108/2226] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:17:55 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:17:55.647580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.649740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:55.668721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a09e6-b7f6-4795-b42e-c000d73ab777 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:55.695211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:55.698030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:55.775753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:55.778106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.778629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.779049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.780369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:55.783010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:55.810426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1109/2227] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:55.825890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1119/2228] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:55.826917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.844123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.845624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:55.854678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699243d-a85e-46d3-a2e1-1fcda00af96b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:55.863185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:55.864093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:55.864475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:55.866272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] PATH_INFO: `/v3/projects/28c55c290854410d8fb0251660cc1efd/users/c70d150a781e450f951184e4373c032a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:55.887801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c55c290854410d8fb0251660cc1efd, user_id=c70d150a781e450f951184e4373c032a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:55.891204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:55.903966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:55.937273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1110/2229] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:55 2022] PUT /identity/v3/projects/28c55c290854410d8fb0251660cc1efd/users/c70d150a781e450f951184e4373c032a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:55.941586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:55.953093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a85f5b-06ef-4e8c-b0af-305ba2fa11db None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.014058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.014711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.015742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.015742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.021813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36432e56-f27d-4646-88d8-8d252d379b69 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.026944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.028948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068764b-83b1-4be9-afa6-294bf92001a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.029405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.029808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068764b-83b1-4be9-afa6-294bf92001a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.030250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068764b-83b1-4be9-afa6-294bf92001a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.030615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068764b-83b1-4be9-afa6-294bf92001a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.031645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068764b-83b1-4be9-afa6-294bf92001a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.035197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068764b-83b1-4be9-afa6-294bf92001a9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.056369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1120/2230] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:56.065806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1111/2231] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:17:56.067036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.079323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d0c01-13b9-4c9a-bc18-ea70512890c8 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.089272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.089940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.090221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.090493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] PATH_INFO: `/v3/projects/28c55c290854410d8fb0251660cc1efd/users/c70d150a781e450f951184e4373c032a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.093490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c55c290854410d8fb0251660cc1efd, user_id=c70d150a781e450f951184e4373c032a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.097967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.113602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1121/2232] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:17:56 2022] PUT /identity/v3/projects/28c55c290854410d8fb0251660cc1efd/users/c70d150a781e450f951184e4373c032a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:56.126883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.127265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.127480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.162568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] MFA Rules not processed for user `c70d150a781e450f951184e4373c032a`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:56.163882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:56.195065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:56.278531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1112/2233] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:56.292064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.294201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:56.416900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d410a-88d1-4855-aaf4-047c6adbd82c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.422744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.423457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.423814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.424222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.443076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.444561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.454588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.456127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:56.459247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1122/2234] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:56.584433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.640588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22be7c-b0d6-4761-b79b-deadcdc61dbb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.660443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.661108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.661498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.661643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] PATH_INFO: `/v3/projects/4d63c7f05cb640ae8858d2c4f0a611fd` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.663481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d63c7f05cb640ae8858d2c4f0a611fd)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.670124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.710373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0117e2c-7549-4c40-bef6-81bfc9400c5e service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:56.727451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:56.728287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.728653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.729858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] PATH_INFO: `/v3/users/41c144d82a744e2ea7b9cc35a68bf445` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.731719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c144d82a744e2ea7b9cc35a68bf445)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:56.734178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:56.755073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:56.766093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d63c7f05cb640ae8858d2c4f0a611fd', 'request_id': 'req-bae1839e-8e74-41b4-962f-4b8b2061519a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.774643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d63c7f05cb640ae8858d2c4f0a611fd', 'request_id': 'req-bae1839e-8e74-41b4-962f-4b8b2061519a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.787361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d63c7f05cb640ae8858d2c4f0a611fd', 'request_id': 'req-bae1839e-8e74-41b4-962f-4b8b2061519a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.827303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] The token cache is being invalidate because project 4d63c7f05cb640ae8858d2c4f0a611fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:56.827759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.828586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.831471 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1113/2235] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:56 2022] DELETE /identity/v3/projects/4d63c7f05cb640ae8858d2c4f0a611fd => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:17:56.838770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:56.840031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c144d82a744e2ea7b9cc35a68bf445'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.844047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:56.854928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c144d82a744e2ea7b9cc35a68bf445'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.855990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c144d82a744e2ea7b9cc35a68bf445'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.856909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c144d82a744e2ea7b9cc35a68bf445'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.889808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b6b0701b-e258-41b1-88f0-54a9c1db94ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c144d82a744e2ea7b9cc35a68bf445'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:56.936509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1123/2236] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:56 2022] DELETE /identity/v3/users/41c144d82a744e2ea7b9cc35a68bf445 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:56.941304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:56.943407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:56.945371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:56.987958 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:57.016199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:57.019035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:57.031466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae1839e-8e74-41b4-962f-4b8b2061519a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:57.123250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1124/2237] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:57.134794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:57.136620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:57.136951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:57.137570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.137986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.138395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] PATH_INFO: `/v3/users/3091625f37fe4cd4bf012998e66a1cd2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.140177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3091625f37fe4cd4bf012998e66a1cd2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:57.142522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:57.228285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3091625f37fe4cd4bf012998e66a1cd2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:57.238424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb20cd-b4ee-43c1-947d-e00ac283e334 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:57.242616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3091625f37fe4cd4bf012998e66a1cd2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:57.245039 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3091625f37fe4cd4bf012998e66a1cd2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:57.248434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad94c49d-7de2-46ca-b45d-c5e41fca23b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:57.249130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94c49d-7de2-46ca-b45d-c5e41fca23b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.249413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94c49d-7de2-46ca-b45d-c5e41fca23b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.256137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad94c49d-7de2-46ca-b45d-c5e41fca23b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.302588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94c49d-7de2-46ca-b45d-c5e41fca23b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:57.304423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad94c49d-7de2-46ca-b45d-c5e41fca23b6 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:57.310580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3091625f37fe4cd4bf012998e66a1cd2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:57.312762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3091625f37fe4cd4bf012998e66a1cd2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:57.316560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1125/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:17:57.336069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1114/2239] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:56 2022] DELETE /identity/v3/users/3091625f37fe4cd4bf012998e66a1cd2 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:57.381815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.382694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.383531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.438114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] MFA Rules not processed for user `cccdcfdf39404cf484e7614254730e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:17:57.439500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:57.488574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:57.575192 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1126/2240] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:17:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:17:57.590428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:57.592252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:57.700205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26dfa94-2da4-47d7-a0c1-000fd22765f7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:57.706970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:57.708081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:57.708540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:57.708883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:57.720177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:57.721990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:57.729182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:57.735079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1115/2241] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:17:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:17:58.109059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:58.111925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:58.238325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5eab45-3e2d-45a9-98aa-eb678b639c25 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:58.245354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:58.246614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:58.247108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:58.247477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] PATH_INFO: `/v3/projects/51c770ad8fb74331a718a330dc66a5e7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:58.281225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c770ad8fb74331a718a330dc66a5e7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:58.290313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:58.374852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c770ad8fb74331a718a330dc66a5e7', 'request_id': 'req-c4dac55a-f819-46d5-a70b-062e09a54e0c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.386801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c770ad8fb74331a718a330dc66a5e7', 'request_id': 'req-c4dac55a-f819-46d5-a70b-062e09a54e0c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.398891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c770ad8fb74331a718a330dc66a5e7', 'request_id': 'req-c4dac55a-f819-46d5-a70b-062e09a54e0c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.417639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] The token cache is being invalidate because project 51c770ad8fb74331a718a330dc66a5e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:58.417939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.418923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.420558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1127/2242] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:58 2022] DELETE /identity/v3/projects/51c770ad8fb74331a718a330dc66a5e7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:58.424585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:58.439122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:58.440749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:58.443447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934991c-62bc-4c67-bb4b-baf7113f8055 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:58.584235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:58.589283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:58.591567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:58.591883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:58.592365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] PATH_INFO: `/v3/users/c70d150a781e450f951184e4373c032a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:58.603740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c70d150a781e450f951184e4373c032a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:58.612692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:58.631354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dac55a-f819-46d5-a70b-062e09a54e0c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:58.643189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:58.644022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:58.644422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:58.644780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] PATH_INFO: `/v3/projects/b24dbc1ce7b540bc8341f1b279e0c453` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:58.646795 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24dbc1ce7b540bc8341f1b279e0c453)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:58.652483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:58.707806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c70d150a781e450f951184e4373c032a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.725771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c70d150a781e450f951184e4373c032a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.726476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c70d150a781e450f951184e4373c032a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.751071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c70d150a781e450f951184e4373c032a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.752670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c70d150a781e450f951184e4373c032a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.772655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24dbc1ce7b540bc8341f1b279e0c453', 'request_id': 'req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.779833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1116/2243] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:58 2022] DELETE /identity/v3/users/c70d150a781e450f951184e4373c032a => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:58.781903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24dbc1ce7b540bc8341f1b279e0c453', 'request_id': 'req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.795794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24dbc1ce7b540bc8341f1b279e0c453', 'request_id': 'req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.839854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] The token cache is being invalidate because project b24dbc1ce7b540bc8341f1b279e0c453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:58.840313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.841393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:58.843489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1128/2244] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:58 2022] DELETE /identity/v3/projects/b24dbc1ce7b540bc8341f1b279e0c453 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:58.847827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:58.851465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:59.013978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcc53c-af9b-4809-8918-8f237a21ae13 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:59.021962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:59.023915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:59.023915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:59.025723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] PATH_INFO: `/v3/users/60b42d617fc74c079f5d404cbfdbe2af` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:59.028548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] RBAC: Authorizing `identity:delete_user(user_id=60b42d617fc74c079f5d404cbfdbe2af)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:59.030735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:59.063518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:59.118459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60b42d617fc74c079f5d404cbfdbe2af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.130908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60b42d617fc74c079f5d404cbfdbe2af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.131774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60b42d617fc74c079f5d404cbfdbe2af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.151862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60b42d617fc74c079f5d404cbfdbe2af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.152681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60b42d617fc74c079f5d404cbfdbe2af'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.168134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1117/2245] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:17:58 2022] DELETE /identity/v3/users/60b42d617fc74c079f5d404cbfdbe2af => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:17:59.568496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:59.571536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:59.669728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa014fe-aa34-41f5-aea6-ab1794ee4ac1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:59.696233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:17:59.698454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:17:59.800481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:17:59.801138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:17:59.801417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:17:59.801756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] PATH_INFO: `/v3/projects/28c55c290854410d8fb0251660cc1efd` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:17:59.802888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c55c290854410d8fb0251660cc1efd)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:17:59.806972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:17:59.879681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:17:59.902923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c55c290854410d8fb0251660cc1efd', 'request_id': 'req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.909745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc635174-48e8-41eb-a33d-53ab013bd20b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:17:59.910753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c55c290854410d8fb0251660cc1efd', 'request_id': 'req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.932733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c55c290854410d8fb0251660cc1efd', 'request_id': 'req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.993695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] The token cache is being invalidate because project 28c55c290854410d8fb0251660cc1efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:17:59.994016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:17:59.997790 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2ede9d2b-f078-444f-9ad1-e1f6df8b7a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:00.001322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1129/2246] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:59 2022] DELETE /identity/v3/projects/28c55c290854410d8fb0251660cc1efd => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:00.007573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8c2b-5055-41c4-9eaa-093f03bc8849 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.007963 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8c2b-5055-41c4-9eaa-093f03bc8849 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.008181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb8c2b-5055-41c4-9eaa-093f03bc8849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.013296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.013882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.014146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.014418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] PATH_INFO: `/v3/projects/7d694d3d22f3431199d9d0aebbbe45e6` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.015606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d694d3d22f3431199d9d0aebbbe45e6)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.017760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.050292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-58eb8c2b-5055-41c4-9eaa-093f03bc8849 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:00.053232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-58eb8c2b-5055-41c4-9eaa-093f03bc8849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:00.068676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1130/2247] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:00.078215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.078843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.079387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.109846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:00.111682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:00.112341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d694d3d22f3431199d9d0aebbbe45e6', 'request_id': 'req-f989fc9a-6b92-481c-a8e1-8bd85a274f64'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:00.114195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:00.128150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d694d3d22f3431199d9d0aebbbe45e6', 'request_id': 'req-f989fc9a-6b92-481c-a8e1-8bd85a274f64'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:00.141988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d694d3d22f3431199d9d0aebbbe45e6', 'request_id': 'req-f989fc9a-6b92-481c-a8e1-8bd85a274f64'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:00.171823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] The token cache is being invalidate because project 7d694d3d22f3431199d9d0aebbbe45e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:00.172181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:00.172815 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f989fc9a-6b92-481c-a8e1-8bd85a274f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:00.174550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1118/2248] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:17:59 2022] DELETE /identity/v3/projects/7d694d3d22f3431199d9d0aebbbe45e6 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:00.179295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d8325-fae8-4d59-9b10-5df9271fda09 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.179585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d8325-fae8-4d59-9b10-5df9271fda09 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.179885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d8325-fae8-4d59-9b10-5df9271fda09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.217501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e99d8325-fae8-4d59-9b10-5df9271fda09 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:00.218821 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e99d8325-fae8-4d59-9b10-5df9271fda09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:00.253597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1131/2249] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:00.257946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.292129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be00bc1-9380-4706-8797-90d6de108365 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.305587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.308625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.309074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.309533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.310357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:00.310828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.312661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.326379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1132/2250] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:00.330611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.342265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188caa08-c490-44a3-8525-92115de5a8b2 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.352919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1119/2251] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:00.353143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.353765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.354045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.354312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.355340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.357407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.357694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.357964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.361509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.390796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:00.392769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:00.402766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1133/2252] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:00.403277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.417030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1120/2253] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:00.424514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.434330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87a72-7437-4af2-a71b-ffeaed017668 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.517910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88338e03-292d-413b-8ea1-f6ad34ba085d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.526937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.528161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.529231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.529727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.531113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.533429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.535074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.535758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.536260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.536629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.537506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:00.537911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.539840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.562533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1121/2254] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:00.566960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.589671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1134/2255] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:00.590187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ec61-b1b3-4bfe-a40a-afbeae6c945e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.591717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.599219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.600149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.600646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.600983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.601899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.612279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05522d8f-ffad-4676-b6af-4d367bf4f13f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.615594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.628774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.629946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.630501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.631158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.632238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.635599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.639282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:00.654444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1135/2256] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:00.655697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1122/2257] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:00.660362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.671418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.676297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0b8cb-f3e1-4792-9fc8-84c3d57be923 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.746611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:00.767277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.768158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.768502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.768869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.769207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46f964-02d4-4bb0-8cf6-6cf7b1766045 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.769692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.771836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.775560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc8ae6-f6ed-4969-9b57-e1707bbabce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.776368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8ae6-f6ed-4969-9b57-e1707bbabce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.776791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8ae6-f6ed-4969-9b57-e1707bbabce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.777258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc8ae6-f6ed-4969-9b57-e1707bbabce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.778395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc8ae6-f6ed-4969-9b57-e1707bbabce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.780794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc8ae6-f6ed-4969-9b57-e1707bbabce3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.794982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1123/2258] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:18:00.796897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4d51-8bb5-4e63-970c-de06d615bec9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.796897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4d51-8bb5-4e63-970c-de06d615bec9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.796897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c4d51-8bb5-4e63-970c-de06d615bec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.807011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1136/2259] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:00.808971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.819446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-549c4d51-8bb5-4e63-970c-de06d615bec9 None None] MFA Rules not processed for user `cccdcfdf39404cf484e7614254730e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:00.820730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-549c4d51-8bb5-4e63-970c-de06d615bec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:00.821197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ae0e6-41f0-42c1-89d2-d8b5a10a62b3 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.827297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.827908 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.828308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.828707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] PATH_INFO: `/v3/projects/b9796b0596aa46a3b75711ead1d867d0/users/bd11c49dac184ae08c1d82e47e222fae/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.847152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9796b0596aa46a3b75711ead1d867d0, user_id=bd11c49dac184ae08c1d82e47e222fae, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.849894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.867483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1137/2260] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:00 2022] PUT /identity/v3/projects/b9796b0596aa46a3b75711ead1d867d0/users/bd11c49dac184ae08c1d82e47e222fae/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:00.868490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:00.897445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1124/2261] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:00.898978 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.899651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.900284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.925925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:00.927317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:00.952874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7beb47-2c9c-43d0-89aa-32917da0511d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:00.962910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:00.963629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:00.964107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:00.964682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:00.965192 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:00.966892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:00.979118 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1138/2262] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:00.983556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:01.004116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765d266-2c8f-4b3d-92d7-9626716e4d87 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:01.015872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:01.016535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:01.017000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:01.017280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:01.017939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:01.019059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1125/2263] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:01.021397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:01.030044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:01.031823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:01.046961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1139/2264] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:01.058603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:01.090176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d6d647-b55f-4f8b-b9b7-523479d24833 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:01.100452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940df3fb-00ca-4387-8bc6-450a2f9e29d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:01.101127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df3fb-00ca-4387-8bc6-450a2f9e29d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:01.101407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df3fb-00ca-4387-8bc6-450a2f9e29d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:01.101687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df3fb-00ca-4387-8bc6-450a2f9e29d6 admin admin] PATH_INFO: `/v3/projects/f145c1a7a27b4a6aa9f366a814ee4a12/users/e0ad527ed1644497a08e85c7e0b59ac6/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:01.135491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940df3fb-00ca-4387-8bc6-450a2f9e29d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f145c1a7a27b4a6aa9f366a814ee4a12, user_id=e0ad527ed1644497a08e85c7e0b59ac6, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:01.138201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940df3fb-00ca-4387-8bc6-450a2f9e29d6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:01.152884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25029c6-a262-4d66-9de4-310158a1cd2c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:01.163010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:01.163797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:01.164118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:01.164394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:01.164713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1140/2265] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:01 2022] PUT /identity/v3/projects/f145c1a7a27b4a6aa9f366a814ee4a12/users/e0ad527ed1644497a08e85c7e0b59ac6/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:01.170124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3c6a-d21a-4fba-ab8a-e481be14408e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:01.170718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3c6a-d21a-4fba-ab8a-e481be14408e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:01.171907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da3c6a-d21a-4fba-ab8a-e481be14408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:01.189845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:01.192819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:01.206836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a1da3c6a-d21a-4fba-ab8a-e481be14408e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:01.209713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a1da3c6a-d21a-4fba-ab8a-e481be14408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:01.217782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1126/2266] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:18:01.242973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:01.315117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1141/2267] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:01.326891 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:01.328572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:01.344434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de73d8-1835-4168-929f-e187b8cb0042 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:01.387484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:01.441463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:01.442347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:01.442812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:01.443398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:01.456188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:01.462344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:01.476136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1127/2268] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:03.486733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726052bc-6804-4a66-9745-de51c7baad4c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:03.487280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726052bc-6804-4a66-9745-de51c7baad4c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:03.487280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726052bc-6804-4a66-9745-de51c7baad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:03.519382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-726052bc-6804-4a66-9745-de51c7baad4c None None] MFA Rules not processed for user `bd11c49dac184ae08c1d82e47e222fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:03.520739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-726052bc-6804-4a66-9745-de51c7baad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:03.604113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1142/2269] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:03.615264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:03.616847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:03.697547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc1dda-94b4-467b-9d68-e54f63647612 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:03.708133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:03.709204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:03.709204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:03.709422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:03.725176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:03.726653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:03.754216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1128/2270] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:05.653531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482e14-600a-439c-8902-b3dcfbbbeee0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:05.654378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482e14-600a-439c-8902-b3dcfbbbeee0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:05.654859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc482e14-600a-439c-8902-b3dcfbbbeee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:05.681913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bc482e14-600a-439c-8902-b3dcfbbbeee0 None None] MFA Rules not processed for user `bd11c49dac184ae08c1d82e47e222fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:05.684254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bc482e14-600a-439c-8902-b3dcfbbbeee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:05.700628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1143/2271] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:07.273055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:07.275889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:07.304629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be4ac2-f30d-4cb3-95b7-6ac3eeb2a2d5 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:07.322306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:07.323367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:07.323910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:07.324394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] PATH_INFO: `/v3/users/4f127e4699c441dea0118c7e64304be8` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:07.327078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f127e4699c441dea0118c7e64304be8)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:07.336480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:07.450893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f127e4699c441dea0118c7e64304be8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:07.464523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f127e4699c441dea0118c7e64304be8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:07.465540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f127e4699c441dea0118c7e64304be8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:07.486508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f127e4699c441dea0118c7e64304be8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:07.487421 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f127e4699c441dea0118c7e64304be8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:07.507165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1129/2272] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:07 2022] DELETE /identity/v3/users/4f127e4699c441dea0118c7e64304be8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:07.511626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:07.512145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:07.512632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:07.540063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:07.541892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:07.637847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1144/2273] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:07.670458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:07.672305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:07.781325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:07.798990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111fc2-22e6-4c71-8933-e4f1ada7e3d0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:07.810950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf236622-1260-4868-9eba-c1efb5def5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:07.810950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf236622-1260-4868-9eba-c1efb5def5bf service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:07.810950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf236622-1260-4868-9eba-c1efb5def5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:07.810950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf236622-1260-4868-9eba-c1efb5def5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:07.830267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf236622-1260-4868-9eba-c1efb5def5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:07.832136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf236622-1260-4868-9eba-c1efb5def5bf service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:07.843856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1130/2274] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:08.382544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:08.385402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:08.399844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15cfd0-10d6-42c5-9dd7-438fba1610f6 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:08.406297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:08.407077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.407273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.407549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] PATH_INFO: `/v3/projects/a7ca967e83f94ab78df620a108481a8e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.409179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7ca967e83f94ab78df620a108481a8e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:08.410985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:08.475835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:08.483881 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7ca967e83f94ab78df620a108481a8e', 'request_id': 'req-322ef433-fb6c-48e5-9524-e935f7c9b0e9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:08.505692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7ca967e83f94ab78df620a108481a8e', 'request_id': 'req-322ef433-fb6c-48e5-9524-e935f7c9b0e9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:08.530923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7ca967e83f94ab78df620a108481a8e', 'request_id': 'req-322ef433-fb6c-48e5-9524-e935f7c9b0e9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:08.558716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] The token cache is being invalidate because project a7ca967e83f94ab78df620a108481a8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:08.559015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:08.561691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-322ef433-fb6c-48e5-9524-e935f7c9b0e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:08.567313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1145/2275] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:08 2022] DELETE /identity/v3/projects/a7ca967e83f94ab78df620a108481a8e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:08.574439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.575685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.576750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.615560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:08.617133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:08.835692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1131/2276] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:08.840469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.840949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.841516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.902252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:08.902912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:08.913966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1146/2277] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:08.918880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:08.932658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116145d1-2154-4618-ad44-2c3304ca4ea0 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:08.946644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:08.947182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:08.947465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:08.947737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:08.948438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:08.948745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:08.968652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa12dd71-bea0-4f7e-8b5d-a0144e7478fe admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:08.989048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1132/2278] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:18:08.993597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.003710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556920a7-b563-4e50-aeaa-8655c17bfc57 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.014767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.015722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.016222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.016344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e30ac-b1d4-4d4f-80ce-94ad3a338e23 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.016675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e30ac-b1d4-4d4f-80ce-94ad3a338e23 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.017077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.017699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e30ac-b1d4-4d4f-80ce-94ad3a338e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.018485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.021352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.079364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1147/2279] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:08 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:09.081303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-768e30ac-b1d4-4d4f-80ce-94ad3a338e23 None None] MFA Rules not processed for user `e0ad527ed1644497a08e85c7e0b59ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:09.082923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-768e30ac-b1d4-4d4f-80ce-94ad3a338e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:09.083852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.272152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7851f0-2cca-4cc7-acb3-c7a7ded70892 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.279986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.280895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.281137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.281614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.282259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.284874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.294853 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1133/2280] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:09.297559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.298501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.299643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.313716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1148/2281] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:09 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:09.314574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.316852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:09.323617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:09.325133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:09.331324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b504521-9d03-45f7-8e28-d669be5c077f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.338527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.339415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.339836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.340164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.340967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.343000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.386845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1149/2282] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:09 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:09.387772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.438576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1134/2283] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:09.438952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.486452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995498-e9ad-49fd-b958-c5d5e6295f5f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.500319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:09.548088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dafd17-8116-4c5b-a8bd-260c6890b0d9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.555899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.557551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.558190 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.558692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.560238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.562121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.577278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1150/2284] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:09.579017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.581317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:09.596157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:09.623334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.624198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.624385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.624665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.625310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.627269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.662418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1135/2285] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:09 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:09.663367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.674803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12609c6-a7cc-47e8-921f-f58a0caa6790 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.682902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.683698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.684008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.684291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.684969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.686976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.707130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1136/2286] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:09.708120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.744146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cede-6acd-4c0b-b36e-ec73d9ce0fab admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.749385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.750394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.750726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.751002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.751654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.753403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835eed7-83f3-45ba-bd2c-cc07fad8f9f0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.755464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.777048 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e65d1-350c-43e7-8623-9b1f3a69381e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.782209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e65d1-350c-43e7-8623-9b1f3a69381e service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.783016 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1137/2287] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:09.786846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.790221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e65d1-350c-43e7-8623-9b1f3a69381e service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.794651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e65d1-350c-43e7-8623-9b1f3a69381e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.806005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382cc739-fe9b-46bd-8b33-bee9552c887a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:09.828701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:09.829472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.829758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.830034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] PATH_INFO: `/v3/projects/23d34fe64b374039bba7a2a3d7940df1/users/74711495f0894ebcbee1afeff7ec7ff4/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:09.875644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d34fe64b374039bba7a2a3d7940df1, user_id=74711495f0894ebcbee1afeff7ec7ff4, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.879127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.900985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1138/2288] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:09 2022] PUT /identity/v3/projects/23d34fe64b374039bba7a2a3d7940df1/users/74711495f0894ebcbee1afeff7ec7ff4/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:09.903250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:09.949876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e65d1-350c-43e7-8623-9b1f3a69381e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:09.954550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e65d1-350c-43e7-8623-9b1f3a69381e service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:09.979972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1151/2289] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:18:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:09.983502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:09.983617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:09.983835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:10.027571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:10.033137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:10.069190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16870d20-0e9c-42a3-8f78-e0393760b798 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:10.094068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:10.094759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:10.095042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:10.095358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] PATH_INFO: `/v3/projects/4145d6862221436793e767d9ee1e32ad/users/57de8052390e49e198809afc336b7d1a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:10.149002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4145d6862221436793e767d9ee1e32ad, user_id=57de8052390e49e198809afc336b7d1a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:10.160787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:10.210960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1139/2290] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:09 2022] PUT /identity/v3/projects/4145d6862221436793e767d9ee1e32ad/users/57de8052390e49e198809afc336b7d1a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:10.218824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:10.269120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1152/2291] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:10.278676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:10.280572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:10.380129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:10.383138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:10.398804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39706e20-9f09-4394-886b-cc5ebf2963eb None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:10.473616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9fd75b-7da4-4cf9-ab97-3c37bc6f7b0f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:10.487515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:10.490089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:10.491557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:10.494768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:10.496101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:10.503904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:10.529184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1140/2292] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:10.532499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:10.555898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66ea231-63a6-4e63-9b13-ae3de5a8df0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:10.557732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea231-63a6-4e63-9b13-ae3de5a8df0b service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:10.562938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea231-63a6-4e63-9b13-ae3de5a8df0b service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:10.563231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66ea231-63a6-4e63-9b13-ae3de5a8df0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:10.576938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ea231-63a6-4e63-9b13-ae3de5a8df0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:10.579176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66ea231-63a6-4e63-9b13-ae3de5a8df0b service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:10.591043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1153/2293] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:10.592049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d6fa6-95c8-48b9-b7f5-bdf6a8755d85 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:10.618663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:10.619510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:10.619876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:10.620316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] PATH_INFO: `/v3/projects/4145d6862221436793e767d9ee1e32ad/users/57de8052390e49e198809afc336b7d1a/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:10.622813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4145d6862221436793e767d9ee1e32ad, user_id=57de8052390e49e198809afc336b7d1a, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:10.627527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:10.643659 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1141/2294] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:10 2022] PUT /identity/v3/projects/4145d6862221436793e767d9ee1e32ad/users/57de8052390e49e198809afc336b7d1a/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:11.426742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a277f6-bc37-4cd3-bbac-2bfff980f5a2 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:11.427032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a277f6-bc37-4cd3-bbac-2bfff980f5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:11.427305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a277f6-bc37-4cd3-bbac-2bfff980f5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:11.451058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d8a277f6-bc37-4cd3-bbac-2bfff980f5a2 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:11.453009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d8a277f6-bc37-4cd3-bbac-2bfff980f5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:11.527230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1154/2295] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 31 12:18:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:11.550323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:11.684840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c32dc1-82bc-44ef-8667-699409039d91 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:11.707501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:11.708485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:11.708960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:11.709423 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:11.721070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:11.723521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:11.734626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1142/2296] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:18:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:12.395624 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b0c45-421e-46b4-a034-78a3422ddaa4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:12.396074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b0c45-421e-46b4-a034-78a3422ddaa4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:12.396396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b0c45-421e-46b4-a034-78a3422ddaa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:12.431433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a74b0c45-421e-46b4-a034-78a3422ddaa4 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:12.433425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a74b0c45-421e-46b4-a034-78a3422ddaa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:12.475103 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1155/2297] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:18:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:12.495906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:12.535543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a9e7d-36fc-497c-80d4-125cb5a14ef7 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:12.546388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:12.548119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:12.548251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:12.548645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:12.563142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:12.565488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:12.577295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1143/2298] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:18:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:13.366755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff72e4-be29-4034-a8e8-394b2258ba07 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:13.367044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff72e4-be29-4034-a8e8-394b2258ba07 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:13.367318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ff72e4-be29-4034-a8e8-394b2258ba07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:13.405078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c1ff72e4-be29-4034-a8e8-394b2258ba07 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:13.406676 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c1ff72e4-be29-4034-a8e8-394b2258ba07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:13.419574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1156/2299] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 31 12:18:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:13.437868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:13.452590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7687c5-3d0c-44d3-b03c-f05443ef8f09 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:13.462729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:13.463534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:13.464250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:13.464695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:13.505243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:13.507738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:13.534356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1144/2300] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:18:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:14.326284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae589d-3d9f-4842-bcd2-c99e55afacc5 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:14.326572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae589d-3d9f-4842-bcd2-c99e55afacc5 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:14.326838 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae589d-3d9f-4842-bcd2-c99e55afacc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:14.410735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-53ae589d-3d9f-4842-bcd2-c99e55afacc5 None None] MFA Rules not processed for user `74711495f0894ebcbee1afeff7ec7ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:14.411985 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-53ae589d-3d9f-4842-bcd2-c99e55afacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:14.534820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1157/2301] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:14.546267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:14.547831 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:14.674776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9609c-241e-4d00-829b-85211d891b7d service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:14.684638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:14.691563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:14.692013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:14.692399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:14.710052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:14.712211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:14.748775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1145/2302] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:16.408152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21999-4df0-4cbd-b385-d486ce247a70 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:16.409008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21999-4df0-4cbd-b385-d486ce247a70 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:16.409281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a21999-4df0-4cbd-b385-d486ce247a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:16.430942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-23a21999-4df0-4cbd-b385-d486ce247a70 None None] MFA Rules not processed for user `74711495f0894ebcbee1afeff7ec7ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:16.432481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-23a21999-4df0-4cbd-b385-d486ce247a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:16.439923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1158/2303] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:16.736327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:16.738560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:16.779909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:16.842176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03140ac4-4389-41f0-ab43-b3c70cf793ac service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:16.848149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:16.849018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:16.849468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:16.850354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] PATH_INFO: `/v3/users/f9e51645219e4c73a472b6d7cc353b8a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:16.851713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9e51645219e4c73a472b6d7cc353b8a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:16.855719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:16.991231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9e51645219e4c73a472b6d7cc353b8a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:17.003900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9e51645219e4c73a472b6d7cc353b8a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:17.004631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9e51645219e4c73a472b6d7cc353b8a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:17.036281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9e51645219e4c73a472b6d7cc353b8a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:17.037109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9e51645219e4c73a472b6d7cc353b8a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:17.055797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1146/2304] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:16 2022] DELETE /identity/v3/users/f9e51645219e4c73a472b6d7cc353b8a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:17.060405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:17.060763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:17.061097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:17.084362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:17.087041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:17.110834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:17.173818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1159/2305] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:17.185261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:17.186927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:17.303003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a5df7-b036-495c-9483-8225b4cf1847 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:17.317935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:17.318722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:17.319107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:17.319484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:17.342138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:17.343718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:17.364882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1147/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:18.137667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:18.139222 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:18.160101 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46fad54-9df4-4ff2-bbb2-7117fa8e3552 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:18.182535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:18.183250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:18.183637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:18.184014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] PATH_INFO: `/v3/projects/b4fa0ca7f1fe4be089f885ea5a10d54d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:18.185612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fa0ca7f1fe4be089f885ea5a10d54d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:18.188431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:18.278372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fa0ca7f1fe4be089f885ea5a10d54d', 'request_id': 'req-faa1bdd4-3431-467c-a609-2c76b4a270b6'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:18.300496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fa0ca7f1fe4be089f885ea5a10d54d', 'request_id': 'req-faa1bdd4-3431-467c-a609-2c76b4a270b6'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:18.316870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fa0ca7f1fe4be089f885ea5a10d54d', 'request_id': 'req-faa1bdd4-3431-467c-a609-2c76b4a270b6'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:18.344466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] The token cache is being invalidate because project b4fa0ca7f1fe4be089f885ea5a10d54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:18.345082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:18.352819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-faa1bdd4-3431-467c-a609-2c76b4a270b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:18.355710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1160/2307] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:18 2022] DELETE /identity/v3/projects/b4fa0ca7f1fe4be089f885ea5a10d54d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:20.714431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:20.716118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:20.733687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3434a-2434-4437-a96b-df12742df78f service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:20.819704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:20.845540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:20.846321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:20.846710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:20.847109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] PATH_INFO: `/v3/users/aecc3a09b79e48529634ee2dcb8e1ca2` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:20.848499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aecc3a09b79e48529634ee2dcb8e1ca2)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:20.851652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:20.948885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aecc3a09b79e48529634ee2dcb8e1ca2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:20.963121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aecc3a09b79e48529634ee2dcb8e1ca2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:20.964050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aecc3a09b79e48529634ee2dcb8e1ca2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:20.998667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aecc3a09b79e48529634ee2dcb8e1ca2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:20.999439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aecc3a09b79e48529634ee2dcb8e1ca2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:21.020189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1148/2308] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:20 2022] DELETE /identity/v3/users/aecc3a09b79e48529634ee2dcb8e1ca2 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:21.298892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:21.299452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:21.299452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:21.352915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] MFA Rules not processed for user `57de8052390e49e198809afc336b7d1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:21.357145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:21.450234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1161/2309] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:21.465233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:21.466785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:21.552448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec5a88e-2c72-4824-8fff-b187c4ae3533 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:21.556772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:21.557474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:21.557791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:21.558155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:21.560000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:21.615375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:21.616877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:21.680403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:21.685278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:21.688783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4477d-af0e-4e63-b331-a05f43dbcc48 service glance] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:21.718643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1149/2310] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:21.741806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ae644-8beb-4729-ad70-5d371c59aa7f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:21.760619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:21.762589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:21.762872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:21.763174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] PATH_INFO: `/v3/projects/fd454516151a49b38ddbd58a351d2484` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:21.767546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd454516151a49b38ddbd58a351d2484)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:21.772338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:21.865131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:21.865770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:21.866200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:21.866422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd454516151a49b38ddbd58a351d2484', 'request_id': 'req-19607551-a66c-41e5-94ca-2e13cba65685'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:21.876441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd454516151a49b38ddbd58a351d2484', 'request_id': 'req-19607551-a66c-41e5-94ca-2e13cba65685'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:21.891782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:21.892304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd454516151a49b38ddbd58a351d2484', 'request_id': 'req-19607551-a66c-41e5-94ca-2e13cba65685'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:21.893088 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:21.907811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] The token cache is being invalidate because project fd454516151a49b38ddbd58a351d2484 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:21.908419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:21.909104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:21.909349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:21.911388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1162/2311] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:21 2022] DELETE /identity/v3/projects/fd454516151a49b38ddbd58a351d2484 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:21.916288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:21.922802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:21.993427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1150/2312] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:18:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:22.001762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:22.004003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:22.022374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19607551-a66c-41e5-94ca-2e13cba65685 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:22.036299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:22.038027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.038955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.040287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] PATH_INFO: `/v3/users/9be0726bb3454e6f995c2f6a86026031` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:22.042453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be0726bb3454e6f995c2f6a86026031)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:22.044739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:22.106870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315501a-d143-4526-aecb-5c0aaba2f6db None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:22.112881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:22.113639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.114010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.114247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be0726bb3454e6f995c2f6a86026031'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.114459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:22.124279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:22.125488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be0726bb3454e6f995c2f6a86026031'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.126127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:22.126461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be0726bb3454e6f995c2f6a86026031'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.127342 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be0726bb3454e6f995c2f6a86026031'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.135645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:22.138689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1151/2313] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:22.146176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f8e3bc14-1a7d-4632-9d1a-e5830dedf644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be0726bb3454e6f995c2f6a86026031'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.167129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1163/2314] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:21 2022] DELETE /identity/v3/users/9be0726bb3454e6f995c2f6a86026031 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:22.500909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:22.514846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b85e06b-db00-418e-bb06-76912f0480cb service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:22.591445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:22.593007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.593354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.593635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] PATH_INFO: `/v3/projects/5dfa2e1c50be4148ba054efbb0c7ac63` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:22.602128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dfa2e1c50be4148ba054efbb0c7ac63)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:22.605416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:22.708961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dfa2e1c50be4148ba054efbb0c7ac63', 'request_id': 'req-f428fdea-41ee-4936-b51f-c48216b67869'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.714931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:22.716399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dfa2e1c50be4148ba054efbb0c7ac63', 'request_id': 'req-f428fdea-41ee-4936-b51f-c48216b67869'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.725699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dfa2e1c50be4148ba054efbb0c7ac63', 'request_id': 'req-f428fdea-41ee-4936-b51f-c48216b67869'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.766756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] The token cache is being invalidate because project 5dfa2e1c50be4148ba054efbb0c7ac63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:22.767315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.768389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f428fdea-41ee-4936-b51f-c48216b67869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:22.770534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1152/2315] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:22 2022] DELETE /identity/v3/projects/5dfa2e1c50be4148ba054efbb0c7ac63 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:22.776508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.777000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.777117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:22.798736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:22.801015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:22.975806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1164/2316] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:22.995778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:22.996200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:22.996486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.062496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:23.063745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:23.114725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.118023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1153/2317] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:23.127922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35726a6b-56d6-4b19-a752-d3eccb463faa None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.141340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.144255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.144873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.145487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.147659 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:23.149674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.151585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.191105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1165/2318] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:18:23.196317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.216642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ab7a1-795c-439f-ba68-9154a56b8757 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.239519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.240516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.240998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.241420 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.242216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.244510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.302085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1154/2319] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:23 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:23.306177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.318569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f25cc-826e-45c1-8cdb-a03a2237274f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.441227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.441868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.442154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.442448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.444393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.447043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.489378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.499471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1166/2320] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:23 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:18:23.507692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fa4b4-3437-4de4-83cb-d456bbcd352d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.515115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.515748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.516075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.520439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.521957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.524689 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.538965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1155/2321] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:23.542742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.559272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce66980f-ae1f-4f22-a26f-ead93f1504bd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.566208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a55719-a7d0-409c-b7b3-cdd508d30ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.567108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a55719-a7d0-409c-b7b3-cdd508d30ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.567581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a55719-a7d0-409c-b7b3-cdd508d30ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.568242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a55719-a7d0-409c-b7b3-cdd508d30ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.569117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a55719-a7d0-409c-b7b3-cdd508d30ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.573013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a55719-a7d0-409c-b7b3-cdd508d30ecd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.594653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1167/2322] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:23.599118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:23.615206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14390de-58e0-4149-a4a5-87b6d0c1778b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:23.624096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:23.624842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.625017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.625424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] PATH_INFO: `/v3/projects/c54a4cc08f5145579e5bf65d8731de1c/users/94a30b204b3645d7b98e6c0632a38dc3/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.649997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54a4cc08f5145579e5bf65d8731de1c, user_id=94a30b204b3645d7b98e6c0632a38dc3, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:23.656216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:23.703318 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1156/2323] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:23 2022] PUT /identity/v3/projects/c54a4cc08f5145579e5bf65d8731de1c/users/94a30b204b3645d7b98e6c0632a38dc3/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:23.705378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:23.705771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:23.706168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:23.834668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] MFA Rules not processed for user `94a30b204b3645d7b98e6c0632a38dc3`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:23.837377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:23.928557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:24.019003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1168/2324] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:24.021550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:24.143709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c894734-1d33-4895-895a-adfb46a7fae4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:24.153040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:24.153542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.153824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.154093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.154738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:24.157804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:24.245514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1157/2325] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:24 2022] POST /identity/v3/projects => generated 373 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:24.252110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:24.273492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f844e-ce5d-498d-9985-043e45dcfd73 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:24.452339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:24.452979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.453393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.453495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.454137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:24.456749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:24.496397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1169/2326] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:24 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:24.500326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:24.516510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34c264-8bb1-4537-9132-ad217c46ef87 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:24.534732 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:24.535359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.535639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.535917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.536602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:24.538196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:24.559098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1158/2327] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:24.562915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:24.601533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28976cf5-e81c-42ae-8cf1-7fcd09ae2071 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:24.621727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:24.622733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.623021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.623296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] PATH_INFO: `/v3/projects/4f49cb1370984501b110ab30daa41326/users/7f6fdf2b41844e32b321427d8682d050/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.644955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f49cb1370984501b110ab30daa41326, user_id=7f6fdf2b41844e32b321427d8682d050, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:24.648445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:24.671419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1170/2328] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:24 2022] PUT /identity/v3/projects/4f49cb1370984501b110ab30daa41326/users/7f6fdf2b41844e32b321427d8682d050/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:24.675681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:24.698668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f5a9e-5ea1-45f1-87e4-9d0d7372a867 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:24.777721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:24.806364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2085a0-a5fb-4d8f-a8e4-e02380110355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:24.807453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2085a0-a5fb-4d8f-a8e4-e02380110355 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.807885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2085a0-a5fb-4d8f-a8e4-e02380110355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.809036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2085a0-a5fb-4d8f-a8e4-e02380110355 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.809863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2085a0-a5fb-4d8f-a8e4-e02380110355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:24.811650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2085a0-a5fb-4d8f-a8e4-e02380110355 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:24.824510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1159/2329] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:24.828916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:24.844897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c10cc-8211-42f4-8dce-3c3475ae1791 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:24.850336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:24.851084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.851457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.851973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] PATH_INFO: `/v3/projects/4f49cb1370984501b110ab30daa41326/users/7f6fdf2b41844e32b321427d8682d050/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.854073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f49cb1370984501b110ab30daa41326, user_id=7f6fdf2b41844e32b321427d8682d050, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:24.862510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:24.881034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1171/2330] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:24 2022] PUT /identity/v3/projects/4f49cb1370984501b110ab30daa41326/users/7f6fdf2b41844e32b321427d8682d050/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:24.890646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:24.891250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:24.891713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:24.943110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] MFA Rules not processed for user `7f6fdf2b41844e32b321427d8682d050`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:24.944798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:25.034412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1160/2331] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:25.046773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:25.049252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:25.131580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae7ada-6f5b-44cb-b8ec-822d23c28a65 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:25.137448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaf02c-bdf3-4564-85c8-bf621d71cdae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:25.138174 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf02c-bdf3-4564-85c8-bf621d71cdae service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:25.138610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf02c-bdf3-4564-85c8-bf621d71cdae service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:25.139076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf02c-bdf3-4564-85c8-bf621d71cdae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:25.208179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:25.273493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aaf02c-bdf3-4564-85c8-bf621d71cdae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:25.275059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aaf02c-bdf3-4564-85c8-bf621d71cdae service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:25.301524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1172/2332] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:28.284596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:28.391409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7178262-6ed5-4372-9ce4-5772c933dbf7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:28.398297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:28.399247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:28.399388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:28.400222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] PATH_INFO: `/v3/users/94a30b204b3645d7b98e6c0632a38dc3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:28.401403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94a30b204b3645d7b98e6c0632a38dc3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:28.405502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:28.527338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94a30b204b3645d7b98e6c0632a38dc3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:28.545260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94a30b204b3645d7b98e6c0632a38dc3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:28.546149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94a30b204b3645d7b98e6c0632a38dc3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:28.568029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94a30b204b3645d7b98e6c0632a38dc3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:28.568979 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94a30b204b3645d7b98e6c0632a38dc3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:28.584281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:28.603048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1161/2333] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:28 2022] DELETE /identity/v3/users/94a30b204b3645d7b98e6c0632a38dc3 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:28.603665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:28.604358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:28.604358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:28.646109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:28.647529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:28.785824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1173/2334] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:28.799205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:28.801025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:28.915922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4d9d-7d44-4a5b-a2a2-41323e03c693 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:28.929206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:28.930360 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:28.930643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:28.930919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:28.952636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:28.954362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:28.977999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1162/2335] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:29.743423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.747335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:29.788801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5930269-167e-4a52-8c35-0b7d7a592906 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:29.804431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:29.807064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:29.807287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:29.807544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] PATH_INFO: `/v3/projects/c54a4cc08f5145579e5bf65d8731de1c` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:29.813567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54a4cc08f5145579e5bf65d8731de1c)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:29.817110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:29.921203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54a4cc08f5145579e5bf65d8731de1c', 'request_id': 'req-88ee97d2-de7f-4991-9301-2bd4c48e3128'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:29.930793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54a4cc08f5145579e5bf65d8731de1c', 'request_id': 'req-88ee97d2-de7f-4991-9301-2bd4c48e3128'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:29.943134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54a4cc08f5145579e5bf65d8731de1c', 'request_id': 'req-88ee97d2-de7f-4991-9301-2bd4c48e3128'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:29.959376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] The token cache is being invalidate because project c54a4cc08f5145579e5bf65d8731de1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:29.960653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:29.961394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:29.967773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1174/2336] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:29 2022] DELETE /identity/v3/projects/c54a4cc08f5145579e5bf65d8731de1c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:29.968512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:29.980205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74c9f-8d82-42b2-8c01-cb5de7024b02 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:30.074010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:30.075606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:30.076720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:30.077376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] PATH_INFO: `/v3/users/7f6fdf2b41844e32b321427d8682d050` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:30.079031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6fdf2b41844e32b321427d8682d050)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:30.081648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:30.167313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6fdf2b41844e32b321427d8682d050'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.181756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6fdf2b41844e32b321427d8682d050'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.184241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6fdf2b41844e32b321427d8682d050'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.202760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6fdf2b41844e32b321427d8682d050'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.203549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3637238e-43bd-46b6-8226-791be59895f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6fdf2b41844e32b321427d8682d050'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.223330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1163/2337] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:29 2022] DELETE /identity/v3/users/7f6fdf2b41844e32b321427d8682d050 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:30.625284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:30.627641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:30.645453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee97d2-de7f-4991-9301-2bd4c48e3128 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:30.749371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:30.749371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:30.750633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:30.750936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] PATH_INFO: `/v3/projects/4f49cb1370984501b110ab30daa41326` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:30.752411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f49cb1370984501b110ab30daa41326)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:30.757533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:30.775299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:30.836808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f49cb1370984501b110ab30daa41326', 'request_id': 'req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.844449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f49cb1370984501b110ab30daa41326', 'request_id': 'req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.854016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f49cb1370984501b110ab30daa41326', 'request_id': 'req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.880827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] The token cache is being invalidate because project 4f49cb1370984501b110ab30daa41326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:30.881391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.886394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-939726fa-5a4e-41d7-b578-e4ddfc9ae5a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:30.893469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1175/2338] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:30 2022] DELETE /identity/v3/projects/4f49cb1370984501b110ab30daa41326 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:30.898884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:30.899871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:30.904883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:30.958696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:30.960397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:30.994225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:31.088014 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1164/2339] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:31.094914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.095249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.095458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.129369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:31.131247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:31.145329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1176/2340] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:31.147635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.182126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2c678-c41f-4b68-9c0b-11965cd4652f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.196194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.198824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.199112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.205453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.206236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:31.206556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.208392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:31.232989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1165/2341] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:18:31.237193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.253356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47566102-42cd-47f0-89ad-326cd330a93a None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.265487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.266215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.266505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.266773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.267435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.269526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:31.325273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1177/2342] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:31 2022] POST /identity/v3/projects => generated 385 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:31.332976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.356929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa767e-a5f4-4b86-9c03-b21ae5fd2c89 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.491280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.492927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.496190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.496729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.498647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.502332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:31.537631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1166/2343] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:31 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:31.542498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.566935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3c72c-a902-4d26-9122-968645c39c83 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.581053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.581860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.582238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.582629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.583387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.585153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:31.616024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.616833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1178/2344] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:31.631015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc730e4e-a4ff-4b2f-aa49-413702962eb1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.636662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc010031-41ed-4a6a-b564-840b13b72ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.637212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010031-41ed-4a6a-b564-840b13b72ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.637491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010031-41ed-4a6a-b564-840b13b72ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.637763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc010031-41ed-4a6a-b564-840b13b72ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.638411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc010031-41ed-4a6a-b564-840b13b72ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.640150 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc010031-41ed-4a6a-b564-840b13b72ebb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:31.653042 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1167/2345] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:18:31.657471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.668420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfefa1-0212-435f-90a6-f51b4cb8c802 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.677042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.677899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.678383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.678720 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] PATH_INFO: `/v3/projects/e6c714fbfe174aa99a46bee2a5a304a1/users/78ddfe6ddf5f4334876df749fa1f8b70/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.698160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c714fbfe174aa99a46bee2a5a304a1, user_id=78ddfe6ddf5f4334876df749fa1f8b70, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.702017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:31.720403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1179/2346] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:31 2022] PUT /identity/v3/projects/e6c714fbfe174aa99a46bee2a5a304a1/users/78ddfe6ddf5f4334876df749fa1f8b70/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:31.731646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.731875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.732130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.779517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] MFA Rules not processed for user `78ddfe6ddf5f4334876df749fa1f8b70`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:31.781307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:31.873030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1168/2347] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:31.874215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:31.986142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2221727-2587-4e63-bedf-2a42da898979 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:31.991860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:31.993205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:31.993588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:31.993965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:31.994786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:31.996961 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.035903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1180/2348] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:31 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:18:32.040419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.053602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1d816-42a8-4f62-b777-a8807e468dc4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.064797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:32.141757 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.142310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.142637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.142856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.143510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.145572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.182219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1169/2349] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:32 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:18:32.186318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.202432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26657b-d8d8-4f1a-993d-46001ea9c366 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.213948 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.214770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.215199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.216004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.216926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.219029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.233693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1181/2350] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:32.237681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.287581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be566d-07ea-4aba-99dd-4f91975778d8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.297255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78e1ca-898f-427e-8e0f-50b1125c5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.300183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e1ca-898f-427e-8e0f-50b1125c5590 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.301392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e1ca-898f-427e-8e0f-50b1125c5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.301824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78e1ca-898f-427e-8e0f-50b1125c5590 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.302653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78e1ca-898f-427e-8e0f-50b1125c5590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.305746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78e1ca-898f-427e-8e0f-50b1125c5590 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.327816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1170/2351] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:32.328739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.364513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aa20aa-1223-434a-bb21-12f9cae38b22 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.373554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.374253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.374537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.374814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] PATH_INFO: `/v3/projects/1e65d702e575490a914ce9257e886261/users/bf2e53a1d0bf42e58cb6fcf92ec990e8/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.377511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:32.397598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e65d702e575490a914ce9257e886261, user_id=bf2e53a1d0bf42e58cb6fcf92ec990e8, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.400616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.424770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1182/2352] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:32 2022] PUT /identity/v3/projects/1e65d702e575490a914ce9257e886261/users/bf2e53a1d0bf42e58cb6fcf92ec990e8/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:18:32.437524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.437883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.442728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.493746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] MFA Rules not processed for user `bf2e53a1d0bf42e58cb6fcf92ec990e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:32.495520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:32.621568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1171/2353] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:32.626663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.719377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1555ccc0-208b-4d49-a450-67c9c6ef7c89 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.727611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.728519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.728866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.729209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.729915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.732086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.776064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1183/2354] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:32 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:32.776986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.789279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb3ceb-7c8e-4304-b500-2b014492b0ce None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.868119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.871209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.871694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.874092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.874858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.876911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.909359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1172/2355] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:32 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:18:32.912979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.938786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0c2ca-c911-46c9-87a7-98d2ac882470 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:32.950360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:32.951481 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:32.951756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:32.952082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:32.954875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:32.956596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:32.981627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1184/2356] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:32 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:32.982962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:32.994548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83796af-79d4-4a60-9e77-2bb93dfe52c5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.001606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.002376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.002725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.003068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] PATH_INFO: `/v3/projects/3e017494ce3642a9941bd262b77e1fd7/users/4fb33447f257497c8cfd5770b7e8b83e/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.012495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:33.027842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e017494ce3642a9941bd262b77e1fd7, user_id=4fb33447f257497c8cfd5770b7e8b83e, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.030868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.056530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1173/2357] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:32 2022] PUT /identity/v3/projects/3e017494ce3642a9941bd262b77e1fd7/users/4fb33447f257497c8cfd5770b7e8b83e/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:33.060349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:33.075582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84937f70-88e5-4624-97fd-5dd8f043e95d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.153699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6275aa1-9e12-49d5-8eef-b5a9b3435fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.154468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275aa1-9e12-49d5-8eef-b5a9b3435fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.154814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275aa1-9e12-49d5-8eef-b5a9b3435fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.155189 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6275aa1-9e12-49d5-8eef-b5a9b3435fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.156419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6275aa1-9e12-49d5-8eef-b5a9b3435fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.158683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6275aa1-9e12-49d5-8eef-b5a9b3435fe4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.182325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1185/2358] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:33 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:33.184401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:33.195941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f2f5d3-3aae-4794-bf99-db4d5a73d28c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.214220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.216120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.216120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.216780 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] PATH_INFO: `/v3/projects/3e017494ce3642a9941bd262b77e1fd7/users/4fb33447f257497c8cfd5770b7e8b83e/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.221200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e017494ce3642a9941bd262b77e1fd7, user_id=4fb33447f257497c8cfd5770b7e8b83e, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.224247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.245902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1174/2359] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:33 2022] PUT /identity/v3/projects/3e017494ce3642a9941bd262b77e1fd7/users/4fb33447f257497c8cfd5770b7e8b83e/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:33.250646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.251584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.251584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.291443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] MFA Rules not processed for user `4fb33447f257497c8cfd5770b7e8b83e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:33.293649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:33.383171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:33.433108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1186/2360] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:33.446350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:33.447990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:33.518285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4459d95-e607-4c7d-afd9-86f9723318df admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:33.526502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc990a73-96f9-4bbd-a65f-d98f7e3953b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:33.527397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990a73-96f9-4bbd-a65f-d98f7e3953b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:33.527720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990a73-96f9-4bbd-a65f-d98f7e3953b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:33.528086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc990a73-96f9-4bbd-a65f-d98f7e3953b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:33.628999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc990a73-96f9-4bbd-a65f-d98f7e3953b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:33.630474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc990a73-96f9-4bbd-a65f-d98f7e3953b7 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:33.649444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1175/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:35.591044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:35.608495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c5ee5-0100-4d31-b3fc-c1c3f58405f4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:35.629310 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:35.630710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:35.641284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:35.641846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:35.790447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:35.801621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:35.815619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1187/2362] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:36.492893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:36.493418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:36.493524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:36.512599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] MFA Rules not processed for user `e0ad527ed1644497a08e85c7e0b59ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:36.513813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:36.572436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1176/2363] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:36.625503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:36.635383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd7199-e8fe-44de-bda2-88e3ac299913 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:36.639116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718569c-7cca-47d2-a757-016962ec20b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:36.639797 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718569c-7cca-47d2-a757-016962ec20b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:36.640044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718569c-7cca-47d2-a757-016962ec20b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:36.640315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718569c-7cca-47d2-a757-016962ec20b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:36.651330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718569c-7cca-47d2-a757-016962ec20b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:36.652824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c718569c-7cca-47d2-a757-016962ec20b9 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:36.665115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1188/2364] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:40.640272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:40.675430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:40.706913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa215c07-00d4-498c-aa0e-a71bad47f3dc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:40.711413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:40.712120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:40.712398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:40.712668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] PATH_INFO: `/v3/users/78ddfe6ddf5f4334876df749fa1f8b70` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:40.713947 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78ddfe6ddf5f4334876df749fa1f8b70)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:40.715862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:40.774873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78ddfe6ddf5f4334876df749fa1f8b70'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:40.783184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78ddfe6ddf5f4334876df749fa1f8b70'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:40.783927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78ddfe6ddf5f4334876df749fa1f8b70'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:40.798077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78ddfe6ddf5f4334876df749fa1f8b70'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:40.799128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78ddfe6ddf5f4334876df749fa1f8b70'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:40.813508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1177/2365] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:40 2022] DELETE /identity/v3/users/78ddfe6ddf5f4334876df749fa1f8b70 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:40.817867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:40.818319 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:40.818411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:40.838397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:40.839505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:40.897669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1189/2366] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:40.907427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:40.908865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:40.966230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2063cc-6dad-49c4-b38a-52286f414476 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:40.969884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:40.970483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:40.970761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:40.971028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:40.979691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:40.981149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:40.990284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1178/2367] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:18:41.275203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:41.276792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:41.288672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e885373-3026-4d96-975c-a0e0d9f04896 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:41.294520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:41.295152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:41.295425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:41.295921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] PATH_INFO: `/v3/projects/e6c714fbfe174aa99a46bee2a5a304a1` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:41.297278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c714fbfe174aa99a46bee2a5a304a1)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:41.299255 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:41.366247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c714fbfe174aa99a46bee2a5a304a1', 'request_id': 'req-5c197cc4-0e12-4ed7-b891-7d88b106a93e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.372892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c714fbfe174aa99a46bee2a5a304a1', 'request_id': 'req-5c197cc4-0e12-4ed7-b891-7d88b106a93e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.376990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:41.382410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c714fbfe174aa99a46bee2a5a304a1', 'request_id': 'req-5c197cc4-0e12-4ed7-b891-7d88b106a93e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.397008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] The token cache is being invalidate because project e6c714fbfe174aa99a46bee2a5a304a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:41.397450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.398992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.401160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1190/2368] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:41 2022] DELETE /identity/v3/projects/e6c714fbfe174aa99a46bee2a5a304a1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:41.405223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:41.421004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7db51-7127-47f5-8eb0-3d8fbc9fb346 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:41.525262 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:41.539928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:41.540859 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:41.541465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:41.541919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] PATH_INFO: `/v3/users/bf2e53a1d0bf42e58cb6fcf92ec990e8` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:41.543229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf2e53a1d0bf42e58cb6fcf92ec990e8)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:41.546063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:41.607687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf2e53a1d0bf42e58cb6fcf92ec990e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.618877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf2e53a1d0bf42e58cb6fcf92ec990e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.620134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf2e53a1d0bf42e58cb6fcf92ec990e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.638062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf2e53a1d0bf42e58cb6fcf92ec990e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.638874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf2e53a1d0bf42e58cb6fcf92ec990e8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:41.655247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1179/2369] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:41 2022] DELETE /identity/v3/users/bf2e53a1d0bf42e58cb6fcf92ec990e8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:42.389035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:42.391086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:42.410787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c197cc4-0e12-4ed7-b891-7d88b106a93e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:42.529264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:42.530038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:42.530321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:42.530597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] PATH_INFO: `/v3/projects/1e65d702e575490a914ce9257e886261` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:42.531756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e65d702e575490a914ce9257e886261)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:42.534781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:42.587703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e65d702e575490a914ce9257e886261', 'request_id': 'req-c3b8bd23-d427-4f08-a289-053da112d249'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.595061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e65d702e575490a914ce9257e886261', 'request_id': 'req-c3b8bd23-d427-4f08-a289-053da112d249'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.604577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e65d702e575490a914ce9257e886261', 'request_id': 'req-c3b8bd23-d427-4f08-a289-053da112d249'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.615645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] The token cache is being invalidate because project 1e65d702e575490a914ce9257e886261 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:42.615937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.616612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.618632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1191/2370] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:42 2022] DELETE /identity/v3/projects/1e65d702e575490a914ce9257e886261 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:42.622657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:42.624433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:42.639768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa901c-c930-47dd-84dc-df4fddfbd58d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:42.719507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:42.720414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:42.720657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:42.721009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] PATH_INFO: `/v3/users/4fb33447f257497c8cfd5770b7e8b83e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:42.723129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fb33447f257497c8cfd5770b7e8b83e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:42.725548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:42.798403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fb33447f257497c8cfd5770b7e8b83e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.808326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fb33447f257497c8cfd5770b7e8b83e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.809323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fb33447f257497c8cfd5770b7e8b83e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.827908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fb33447f257497c8cfd5770b7e8b83e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.829033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2f1fc679-b3ec-4449-811c-e131a6b0a3ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fb33447f257497c8cfd5770b7e8b83e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:42.836790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:42.852163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1180/2371] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:18:42 2022] DELETE /identity/v3/users/4fb33447f257497c8cfd5770b7e8b83e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:43.307980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:43.310529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:43.336895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8bd23-d427-4f08-a289-053da112d249 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:43.339256 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.339723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.340185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.417252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:43.423052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:43.439779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:43.441251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.441542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.441816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] PATH_INFO: `/v3/projects/3e017494ce3642a9941bd262b77e1fd7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.443127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e017494ce3642a9941bd262b77e1fd7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:43.445979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:43.480213 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:43.516567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1181/2372] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:43.540276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e017494ce3642a9941bd262b77e1fd7', 'request_id': 'req-9c805b4f-84d8-4090-b3b2-8b93d94ce983'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:43.540602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:43.542326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:43.555401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e017494ce3642a9941bd262b77e1fd7', 'request_id': 'req-9c805b4f-84d8-4090-b3b2-8b93d94ce983'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:43.566315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e017494ce3642a9941bd262b77e1fd7', 'request_id': 'req-9c805b4f-84d8-4090-b3b2-8b93d94ce983'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:43.589128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] The token cache is being invalidate because project 3e017494ce3642a9941bd262b77e1fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:18:43.589663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:43.590748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-9c805b4f-84d8-4090-b3b2-8b93d94ce983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:18:43.593154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1192/2373] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:18:43 2022] DELETE /identity/v3/projects/3e017494ce3642a9941bd262b77e1fd7 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:43.598305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed496ce-ef0c-4728-9b21-2e1495f23ed3 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.598789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed496ce-ef0c-4728-9b21-2e1495f23ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.599337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed496ce-ef0c-4728-9b21-2e1495f23ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.629506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-eed496ce-ef0c-4728-9b21-2e1495f23ed3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:43.631350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-eed496ce-ef0c-4728-9b21-2e1495f23ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:43.707465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a257027-66e9-4033-a6d7-948c9c39fac2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:43.733813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1193/2374] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:43.741827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.743429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.743429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.768833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:43.770581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:43.786100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1194/2375] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:43.791141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:43.800974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3a7db-ab1e-40b9-ac75-12db00485cec None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:43.806361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:43.806960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.807233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.807501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.808172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:18:43.808472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:43.810299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:43.811464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:43.812375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.812849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.813268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.816630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:43.829610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1195/2376] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:18:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:18:43.833764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:43.845616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882da91f-df9b-4acb-b533-fbf3876af8fa admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:43.850495 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:43.851711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:43.852080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:43.852399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:43.853036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:43.855024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:43.884582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:43.893438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1196/2377] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:18:43 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:18:43.897775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:43.913511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:43.916101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:43.927614 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1182/2378] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:18:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:18:43.996603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d400c8-297e-42e9-a288-8f558b8fc5f0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:44.003988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf70358-0534-4fdd-9000-99e63feb1600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:44.004627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf70358-0534-4fdd-9000-99e63feb1600 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.005050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf70358-0534-4fdd-9000-99e63feb1600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.005485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf70358-0534-4fdd-9000-99e63feb1600 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.005983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf70358-0534-4fdd-9000-99e63feb1600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:44.008467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf70358-0534-4fdd-9000-99e63feb1600 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:44.042546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:18:44.072582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1197/2379] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:18:43 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:18:44.073832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:44.102945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5da630-eaec-4f65-b0c4-c7f5e28209c2 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:44.120687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89853e-c5ac-487e-8756-bc83c6c602e0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.121014 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89853e-c5ac-487e-8756-bc83c6c602e0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.121268 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89853e-c5ac-487e-8756-bc83c6c602e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.127475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:44.128131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.128412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.128683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.129330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:44.130977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:44.168074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1183/2380] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:44.169681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6f89853e-c5ac-487e-8756-bc83c6c602e0 None None] MFA Rules not processed for user `d452a433fe3d45018e247cc9424cafbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:44.171372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:44.173849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6f89853e-c5ac-487e-8756-bc83c6c602e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:44.194343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f89be0-a10c-4c1e-b87c-efd6b9f0dbec admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:44.217366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:44.219820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.221075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.222454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.224352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:44.231140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:44.257709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1184/2381] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:18:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:18:44.262258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:44.303469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70360d9b-a4a2-4258-9991-4a0e07625e93 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:44.316765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39cb68-dbda-4ae9-b455-208856909926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:44.318312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cb68-dbda-4ae9-b455-208856909926 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.318918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cb68-dbda-4ae9-b455-208856909926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.319525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39cb68-dbda-4ae9-b455-208856909926 admin admin] PATH_INFO: `/v3/projects/65da9184643a4d0e8dd12692b7ee96c7/users/33ec02eebe7947179c5d7e9778d93b05/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.356893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1198/2382] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:18:44.405446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39cb68-dbda-4ae9-b455-208856909926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65da9184643a4d0e8dd12692b7ee96c7, user_id=33ec02eebe7947179c5d7e9778d93b05, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:44.408180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39cb68-dbda-4ae9-b455-208856909926 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:44.471547 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1185/2383] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:18:44 2022] PUT /identity/v3/projects/65da9184643a4d0e8dd12692b7ee96c7/users/33ec02eebe7947179c5d7e9778d93b05/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:18:44.493324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.495146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.496188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.583727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] MFA Rules not processed for user `33ec02eebe7947179c5d7e9778d93b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:44.588267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:44.738097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1199/2384] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:44.802913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f875f-88e4-473a-8ba7-0bba4a09307f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:44.803334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f875f-88e4-473a-8ba7-0bba4a09307f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:44.803621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f875f-88e4-473a-8ba7-0bba4a09307f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:44.839344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6f3f875f-88e4-473a-8ba7-0bba4a09307f None None] MFA Rules not processed for user `bd11c49dac184ae08c1d82e47e222fae`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:18:44.840741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6f3f875f-88e4-473a-8ba7-0bba4a09307f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:44.926554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1186/2385] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:18:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:18:54.103866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:18:54.105433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:18:54.165994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada34f-3979-498f-be33-eccdb4076ab8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:18:54.169579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:18:54.170180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:18:54.170455 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:18:54.170723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:18:54.178944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:18:54.180429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:18:54.190736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1200/2386] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:18:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:18:54.918817 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=53,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:04.185378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=85 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:16.505879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cae3f-c978-4d10-b148-a3a9954c8a56 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:16.507569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cae3f-c978-4d10-b148-a3a9954c8a56 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:16.508121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17cae3f-c978-4d10-b148-a3a9954c8a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:16.532285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f17cae3f-c978-4d10-b148-a3a9954c8a56 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:16.534367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f17cae3f-c978-4d10-b148-a3a9954c8a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:16.609851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1187/2387] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:16.788212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:16.788212 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:16.885154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f37c8-206a-425c-936d-4831560c7051 service glance] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:16.891097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:16.892389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:16.892915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:16.893244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:16.905800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:16.909058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:16.931844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1201/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:26.599527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=27 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:26.847972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:26.848292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:26.848576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:26.874208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:26.875846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:26.885149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1188/2389] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:26.910499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:26.911927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:26.926890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e8feac-f353-4f4f-9842-be7249de3d58 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:26.932606 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a95b5c-77aa-4b6a-a988-47d092e87b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:26.933209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95b5c-77aa-4b6a-a988-47d092e87b2a service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:26.933488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95b5c-77aa-4b6a-a988-47d092e87b2a service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:26.933760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a95b5c-77aa-4b6a-a988-47d092e87b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:26.942864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a95b5c-77aa-4b6a-a988-47d092e87b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:26.944603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a95b5c-77aa-4b6a-a988-47d092e87b2a service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:26.961294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1202/2390] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:31.296611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:31.306674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093f8bc0-9181-4778-9b3b-0120adfe13ef None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:31.311211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:31.311819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:31.312127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:31.312397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] PATH_INFO: `/v3/users/33ec02eebe7947179c5d7e9778d93b05` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:31.313501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33ec02eebe7947179c5d7e9778d93b05)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:31.315551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:31.360928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33ec02eebe7947179c5d7e9778d93b05'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:31.369214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33ec02eebe7947179c5d7e9778d93b05'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:31.369865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33ec02eebe7947179c5d7e9778d93b05'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:31.382475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33ec02eebe7947179c5d7e9778d93b05'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:31.383112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33ec02eebe7947179c5d7e9778d93b05'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:31.394926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1189/2391] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:19:31 2022] DELETE /identity/v3/users/33ec02eebe7947179c5d7e9778d93b05 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:19:31.399765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:31.400195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:31.400195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:31.419097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:31.420336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:31.478664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1203/2392] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:31.488359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:31.489794 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:31.550967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f87213-bb06-4306-ad04-e525766cb002 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:31.554697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f0b1d-902a-4d89-be22-b92aac1d8891 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:31.555259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0b1d-902a-4d89-be22-b92aac1d8891 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:31.555538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0b1d-902a-4d89-be22-b92aac1d8891 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:31.555811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f0b1d-902a-4d89-be22-b92aac1d8891 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:31.564912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f0b1d-902a-4d89-be22-b92aac1d8891 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:31.566351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f0b1d-902a-4d89-be22-b92aac1d8891 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:31.576758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1190/2393] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:31.915539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:31.922164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:31.935588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a9008-29b6-48e4-b143-fcc8c2898959 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:31.942332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:31.943109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:31.943514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:31.944510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] PATH_INFO: `/v3/projects/65da9184643a4d0e8dd12692b7ee96c7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:31.946018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65da9184643a4d0e8dd12692b7ee96c7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:31.948352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.015142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65da9184643a4d0e8dd12692b7ee96c7', 'request_id': 'req-a87467a4-8b7c-464c-b816-72e379968e10'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:32.021258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65da9184643a4d0e8dd12692b7ee96c7', 'request_id': 'req-a87467a4-8b7c-464c-b816-72e379968e10'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:32.029026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65da9184643a4d0e8dd12692b7ee96c7', 'request_id': 'req-a87467a4-8b7c-464c-b816-72e379968e10'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:32.033902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:32.044042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] The token cache is being invalidate because project 65da9184643a4d0e8dd12692b7ee96c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:19:32.044574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:32.045617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a87467a4-8b7c-464c-b816-72e379968e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:19:32.047204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1204/2394] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:19:31 2022] DELETE /identity/v3/projects/65da9184643a4d0e8dd12692b7ee96c7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:19:32.052095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.052391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.052671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.073172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:32.074401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:32.136462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1191/2395] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:32.144529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.144824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.145100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.173280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:32.174511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:32.182974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1205/2396] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:32.187473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.198698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94744f7-d314-4fbf-a344-20fcf12541d3 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.203533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.204171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.204453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.204724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.205372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:19:32.205673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.207253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.209616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:32.221159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1192/2397] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:19:32.225553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.234982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ba918-a6fe-41ac-8d9d-2cb378dc8d7e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.239765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.240928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.241208 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.241476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.242115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.244042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.280581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1206/2398] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:19:32 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:19:32.284509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.296272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe2330-7683-4b43-af88-67da447106e9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.353343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.354028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.354208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.354478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.355209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.357146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.377760 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1193/2399] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:19:32 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:19:32.382614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.393572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ab4dcb-809d-473e-b428-8d9991e31478 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.398073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.398662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.398937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.399205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.399834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.401489 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.411142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1207/2400] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:19:32.415530 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.425470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8de47-fed4-4d36-8c31-baca87bf48f5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.430715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266d327-7750-4624-9da9-26c76954faec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.431302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d327-7750-4624-9da9-26c76954faec admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.431582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d327-7750-4624-9da9-26c76954faec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.431854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266d327-7750-4624-9da9-26c76954faec admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.432526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266d327-7750-4624-9da9-26c76954faec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.434115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266d327-7750-4624-9da9-26c76954faec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.445097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1194/2401] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:19:32.449202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.459600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6c782-17ee-4f48-ab18-2fd009c10a82 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.464157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.464798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.465075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.465344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] PATH_INFO: `/v3/projects/9412ac98893843049e711b3d3aca5d54/users/e903bd4fb49443928a84021498acb392/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.480279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9412ac98893843049e711b3d3aca5d54, user_id=e903bd4fb49443928a84021498acb392, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.482904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.496237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1208/2402] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:19:32 2022] PUT /identity/v3/projects/9412ac98893843049e711b3d3aca5d54/users/e903bd4fb49443928a84021498acb392/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:19:32.507624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a03b0-c130-4677-8ae9-ae9df91743d7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.507892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a03b0-c130-4677-8ae9-ae9df91743d7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.508380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a03b0-c130-4677-8ae9-ae9df91743d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.544439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-618a03b0-c130-4677-8ae9-ae9df91743d7 None None] MFA Rules not processed for user `e903bd4fb49443928a84021498acb392`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:32.545580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-618a03b0-c130-4677-8ae9-ae9df91743d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:32.609164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1195/2403] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:19:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:32.621184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:32.623252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:32.681461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ea72a-de8e-42b0-84f8-2708a225d3e0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:32.685074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:32.685678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:32.685960 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:32.686233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:32.695009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:32.696486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:32.705450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1209/2404] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:35.498327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:35.498879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:35.499190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:35.521985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:35.523376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:35.594709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1196/2405] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:35.654109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:35.660516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:35.664851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:35.666351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:35.673201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:35.742340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4519c8b9-4efc-41e8-ac14-9e2ce72b0acf None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:35.746101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:35.747129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:35.747129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:35.747448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:35.749086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:35.766284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228372c-6c6b-46f6-8dbc-cd55ac27b8b4 service glance] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:35.772931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0247cfe-0d79-4f30-aa05-8f108c95a2e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:35.773829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247cfe-0d79-4f30-aa05-8f108c95a2e1 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:35.774326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247cfe-0d79-4f30-aa05-8f108c95a2e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:35.774839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0247cfe-0d79-4f30-aa05-8f108c95a2e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:35.792341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0247cfe-0d79-4f30-aa05-8f108c95a2e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:35.794115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0247cfe-0d79-4f30-aa05-8f108c95a2e1 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:35.809393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1210/2406] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:35.845865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:35.845865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6721c8-ef60-4e24-be00-b3f1371f0182 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:35.854385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1197/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:19:39.608226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3516e-eda9-42a0-8d98-091438e3ec7c None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:39.609077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3516e-eda9-42a0-8d98-091438e3ec7c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:39.609508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3516e-eda9-42a0-8d98-091438e3ec7c None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:39.611526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1211/2408] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:19:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:19:39.640934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:39.641478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:39.641478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:39.676517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:39.678629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:39.688985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1198/2409] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:19:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:40.074962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3516e-eda9-42a0-8d98-091438e3ec7c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:40.095591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3516e-eda9-42a0-8d98-091438e3ec7c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:40.107880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25057b1-0e79-458c-948f-187f4c6a4bd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:40.108727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25057b1-0e79-458c-948f-187f4c6a4bd4 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:40.109494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25057b1-0e79-458c-948f-187f4c6a4bd4 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:40.109494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25057b1-0e79-458c-948f-187f4c6a4bd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:40.120018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25057b1-0e79-458c-948f-187f4c6a4bd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:40.121770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25057b1-0e79-458c-948f-187f4c6a4bd4 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:40.134911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1212/2410] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:42.281152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.282694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:42.391608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0ddda7-575c-43d7-bd2c-57a5de4943db None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.399148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.400046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.403456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.403763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.407065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:42.424576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:42.428146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abfab2-ae23-4362-86eb-91dcfe2c0207 service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:42.442102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1199/2411] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:42.611638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.612164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.612349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.629778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:42.640934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:42.643066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:42.702115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.703060 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.703813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.728173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:42.730087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:42.738678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1213/2412] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:19:42.748837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1200/2413] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:42.767283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.768765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:42.775089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:42.776707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:42.839249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313c669-383e-4080-981d-1c4ee3c6abfb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.856543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a0d1a-a2b9-4a6d-bee9-1c6e1f7a91d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.857207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a0d1a-a2b9-4a6d-bee9-1c6e1f7a91d0 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.857490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a0d1a-a2b9-4a6d-bee9-1c6e1f7a91d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.857764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a0d1a-a2b9-4a6d-bee9-1c6e1f7a91d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.913787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a0d1a-a2b9-4a6d-bee9-1c6e1f7a91d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:42.917911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a0d1a-a2b9-4a6d-bee9-1c6e1f7a91d0 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:42.952807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1201/2414] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:42.972553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5b67ed-14db-493b-b6d1-d732ea1b58e0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:42.978287 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:42.979024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:42.979311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:42.979587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:42.991052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:42.992891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:43.007246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1214/2415] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:19:47.617399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f456b-bae3-4b9f-8893-9dabfc014201 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:47.617996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f456b-bae3-4b9f-8893-9dabfc014201 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:47.617996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f456b-bae3-4b9f-8893-9dabfc014201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:47.638726 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-663f456b-bae3-4b9f-8893-9dabfc014201 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:47.640239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-663f456b-bae3-4b9f-8893-9dabfc014201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:47.648908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1202/2416] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:19:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:47.666764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:47.679449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dc02bf-0ba1-4b75-a941-15eea207e560 service swift] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:47.691207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:47.692162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:47.692469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:47.692793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:47.710403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:47.713704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:47.725079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1215/2417] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:19:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:19:49.221330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5444f-40ab-43da-bd44-e76fa3b78d52 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:49.222552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5444f-40ab-43da-bd44-e76fa3b78d52 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:49.223033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5444f-40ab-43da-bd44-e76fa3b78d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:49.257384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-46f5444f-40ab-43da-bd44-e76fa3b78d52 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:49.260034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-46f5444f-40ab-43da-bd44-e76fa3b78d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:49.271028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1203/2418] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:19:49.310404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:49.338487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7d852-d470-4acc-9bed-eef691f08937 service swift] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:49.361970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:49.363964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:49.364352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:49.364843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:49.388981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:49.391159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:49.427043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1216/2419] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:19:54.701443 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410095-cf86-424d-8fd9-d2c54e9d8b24 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:54.702069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410095-cf86-424d-8fd9-d2c54e9d8b24 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:54.702069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90410095-cf86-424d-8fd9-d2c54e9d8b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:54.711489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:19:54.723036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-90410095-cf86-424d-8fd9-d2c54e9d8b24 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:19:54.724273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-90410095-cf86-424d-8fd9-d2c54e9d8b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:19:54.732205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1204/2420] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:19:54.862820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:19:54.877719 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be57862-f3f6-4910-a31a-082ff7e40fc9 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:19:54.884006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e0a605-962a-4110-9c1b-428cf518682f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:19:54.884677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0a605-962a-4110-9c1b-428cf518682f service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:19:54.885182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0a605-962a-4110-9c1b-428cf518682f service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:19:54.885658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e0a605-962a-4110-9c1b-428cf518682f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:19:54.895000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0a605-962a-4110-9c1b-428cf518682f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:19:54.898383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e0a605-962a-4110-9c1b-428cf518682f service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:19:54.910882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1217/2421] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:03.078900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf25d-e9c5-4c57-9a84-fe8362571c5f None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.079466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf25d-e9c5-4c57-9a84-fe8362571c5f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.079466 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bf25d-e9c5-4c57-9a84-fe8362571c5f None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.080996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1205/2422] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:03.087986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb77f3f-9e74-4754-9f8b-ba608d888fbc None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.089015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb77f3f-9e74-4754-9f8b-ba608d888fbc None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.089303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb77f3f-9e74-4754-9f8b-ba608d888fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.124695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8eb77f3f-9e74-4754-9f8b-ba608d888fbc None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:03.126067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8eb77f3f-9e74-4754-9f8b-ba608d888fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:03.144530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1218/2423] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:20:03.152998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf25d-e9c5-4c57-9a84-fe8362571c5f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.171629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bf25d-e9c5-4c57-9a84-fe8362571c5f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.184365 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6bc067-5098-4f16-b314-fed8b9d5879a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.187184 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bc067-5098-4f16-b314-fed8b9d5879a service glance] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.187482 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bc067-5098-4f16-b314-fed8b9d5879a service glance] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.188773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6bc067-5098-4f16-b314-fed8b9d5879a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.210517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bc067-5098-4f16-b314-fed8b9d5879a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.212738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6bc067-5098-4f16-b314-fed8b9d5879a service glance] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.226597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1206/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:03.305012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97cb36-2bf2-4568-a463-31068d6c0294 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.305829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97cb36-2bf2-4568-a463-31068d6c0294 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.306467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97cb36-2bf2-4568-a463-31068d6c0294 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.308247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1219/2425] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:20:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:03.314224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4055689-e34b-4114-bde9-b15e3d9aa999 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.314638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4055689-e34b-4114-bde9-b15e3d9aa999 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.315020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4055689-e34b-4114-bde9-b15e3d9aa999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.338852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c4055689-e34b-4114-bde9-b15e3d9aa999 None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:03.340225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c4055689-e34b-4114-bde9-b15e3d9aa999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:03.352133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1207/2426] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:03.366173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97cb36-2bf2-4568-a463-31068d6c0294 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.378662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97cb36-2bf2-4568-a463-31068d6c0294 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.383180 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef02cd-bd0e-4a75-87f4-35a7f4e971e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.383848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef02cd-bd0e-4a75-87f4-35a7f4e971e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.384223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef02cd-bd0e-4a75-87f4-35a7f4e971e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.384564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef02cd-bd0e-4a75-87f4-35a7f4e971e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.393073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef02cd-bd0e-4a75-87f4-35a7f4e971e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.394644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef02cd-bd0e-4a75-87f4-35a7f4e971e9 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.403132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1220/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:20:03.513548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1a616-a605-4368-9b7c-5bef503173c7 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.513548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1a616-a605-4368-9b7c-5bef503173c7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.513548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd1a616-a605-4368-9b7c-5bef503173c7 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.514795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1208/2428] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:20:03.523032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c0da-3bdb-4b37-b369-91bacf12fd8e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.523309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c0da-3bdb-4b37-b369-91bacf12fd8e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.523588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c0da-3bdb-4b37-b369-91bacf12fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.680912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4d60c0da-3bdb-4b37-b369-91bacf12fd8e None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:03.682135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4d60c0da-3bdb-4b37-b369-91bacf12fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:03.733332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1221/2429] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:20:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:03.745255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1a616-a605-4368-9b7c-5bef503173c7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:03.753141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0dd1a616-a605-4368-9b7c-5bef503173c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:03.796263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd1a616-a605-4368-9b7c-5bef503173c7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:03.800510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:03.801097 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:03.801379 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:03.801649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:03.824116 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:03.826698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:03.839939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1209/2430] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:05.876907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:05.877426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:05.877426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:05.897360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:05.898554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:05.905724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1222/2431] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 31 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:05.918533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:05.930685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a59e1-f240-43d6-b0e8-69c7a5121887 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:05.935634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:05.936264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:05.936537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:05.936808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:05.945399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:05.946974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:05.955590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1210/2432] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:20:07.971303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:07.972799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:07.988511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eaf61-905b-4910-a3bb-c3de7ae81967 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:07.993230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:07.993870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:07.994143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:07.994415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] PATH_INFO: `/v3/users/bd11c49dac184ae08c1d82e47e222fae` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:07.995573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd11c49dac184ae08c1d82e47e222fae)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:07.997570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.027860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:08.064050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd11c49dac184ae08c1d82e47e222fae'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.072269 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd11c49dac184ae08c1d82e47e222fae'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.073778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd11c49dac184ae08c1d82e47e222fae'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.074855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd11c49dac184ae08c1d82e47e222fae'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.087573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f5c4db1c-b0af-4da6-831a-6e092fb7bfbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd11c49dac184ae08c1d82e47e222fae'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.100891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1223/2433] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:20:07 2022] DELETE /identity/v3/users/bd11c49dac184ae08c1d82e47e222fae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:08.291397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.308723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1b08d-434e-4003-9756-bdbe777e88b1 service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.377200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.378183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.378464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.378734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] PATH_INFO: `/v3/projects/b9796b0596aa46a3b75711ead1d867d0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.380661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9796b0596aa46a3b75711ead1d867d0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:08.382771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.438767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9796b0596aa46a3b75711ead1d867d0', 'request_id': 'req-7425e491-23ff-4693-b62e-7f302438cd5b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.447884 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9796b0596aa46a3b75711ead1d867d0', 'request_id': 'req-7425e491-23ff-4693-b62e-7f302438cd5b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.455196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9796b0596aa46a3b75711ead1d867d0', 'request_id': 'req-7425e491-23ff-4693-b62e-7f302438cd5b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.480602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] The token cache is being invalidate because project b9796b0596aa46a3b75711ead1d867d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:20:08.481254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.482376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7425e491-23ff-4693-b62e-7f302438cd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:08.485195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1211/2434] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:20:08 2022] DELETE /identity/v3/projects/b9796b0596aa46a3b75711ead1d867d0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:08.491049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.491419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.491782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.520396 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:08.522217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:08.600003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1224/2435] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:20:08.607344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.607642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.607904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.629555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:08.631066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:08.640030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1212/2436] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:08.644876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.658761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b926f3-ee06-4d5c-8e42-968bca7ce730 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.665196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.665982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.666307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.666580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.667284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:08.667592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:08.670551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.693257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1225/2437] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:08.697800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.711437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f48a4-3838-422b-b07c-f2c7e40aac99 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.724638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.725340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.725764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.726047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.726693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:08.729481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.781519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1213/2438] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:20:08 2022] POST /identity/v3/projects => generated 375 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:20:08.785585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.798890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c317c1-09ea-4ca3-a539-36e0e0045e02 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.867353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.868051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.868333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.868627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.869295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:08.871388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.891464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1226/2439] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:20:08 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:20:08.895557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.906586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5ceb-6bb3-442a-9221-306fa26b295c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.912055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.912477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.912761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.913032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.913677 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:08.915314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.930473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1214/2440] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:08.934502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.944497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f92bd-e38e-465e-8800-627d4514eb30 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.949115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85764953-41ec-43dc-9bef-1ae7dbf03b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.949968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764953-41ec-43dc-9bef-1ae7dbf03b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.950245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764953-41ec-43dc-9bef-1ae7dbf03b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.950515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85764953-41ec-43dc-9bef-1ae7dbf03b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:08.951151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85764953-41ec-43dc-9bef-1ae7dbf03b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:08.952823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85764953-41ec-43dc-9bef-1ae7dbf03b34 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:08.962852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1227/2441] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:08.967173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:08.972559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:08.979506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbada3c-8321-4e85-ac54-9c95d808543d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:08.985533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:08.986190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:08.986495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:08.986786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] PATH_INFO: `/v3/projects/3f0168718ba34fefb27a8d55db1ee6d7/users/081d541deff64cfea87850fadc635d97/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:09.001873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0168718ba34fefb27a8d55db1ee6d7, user_id=081d541deff64cfea87850fadc635d97, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:09.004632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:09.017368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1215/2442] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:20:08 2022] PUT /identity/v3/projects/3f0168718ba34fefb27a8d55db1ee6d7/users/081d541deff64cfea87850fadc635d97/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:09.027702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32835-1345-4799-aba7-4083000d86e6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:09.028235 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32835-1345-4799-aba7-4083000d86e6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:09.028344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe32835-1345-4799-aba7-4083000d86e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:09.042542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:09.059729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2fe32835-1345-4799-aba7-4083000d86e6 None None] MFA Rules not processed for user `081d541deff64cfea87850fadc635d97`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:09.060973 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2fe32835-1345-4799-aba7-4083000d86e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:09.132687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1228/2443] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:09.144782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:09.149791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:09.224687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9eb631-0a86-4789-8c28-341057f5fa50 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:09.228775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:09.229869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:09.230107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:09.230565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:09.240450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:09.242143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:09.253394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1216/2444] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:10.446477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:10.447147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:10.447250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:10.468051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:10.469292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:10.528943 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1229/2445] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:20:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:20:10.541368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:10.543310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:10.616340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cace4-e6c0-4051-8669-10f3cecf9498 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:10.621369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f20d9b-1e6d-41ee-bbae-ba04a326b97c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:10.621972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f20d9b-1e6d-41ee-bbae-ba04a326b97c service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:10.622249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f20d9b-1e6d-41ee-bbae-ba04a326b97c service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:10.622519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f20d9b-1e6d-41ee-bbae-ba04a326b97c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:10.631317 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f20d9b-1e6d-41ee-bbae-ba04a326b97c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:10.632936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f20d9b-1e6d-41ee-bbae-ba04a326b97c service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:10.641040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1217/2446] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:20:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:20:12.411883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:12.414942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:12.507100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a2993d-186e-4dfa-a8ae-e8716bd5692e None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:12.516830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:12.519596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:12.519885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:12.520435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] PATH_INFO: `/v3/users/e903bd4fb49443928a84021498acb392` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:12.521586 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e903bd4fb49443928a84021498acb392)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:12.523566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:12.599359 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:12.609861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e903bd4fb49443928a84021498acb392'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:12.623561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e903bd4fb49443928a84021498acb392'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:12.624532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e903bd4fb49443928a84021498acb392'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:12.625378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e903bd4fb49443928a84021498acb392'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:12.640504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e903bd4fb49443928a84021498acb392'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:12.663997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1230/2447] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:20:12 2022] DELETE /identity/v3/users/e903bd4fb49443928a84021498acb392 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:12.671472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:12.672454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:12.674033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:12.739507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:12.747823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:12.861938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1218/2448] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:20:12.873488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:12.874984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:12.960425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eef757-33a9-4b53-abe8-f0f4c7b0da1d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:12.963587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2890c-18c8-4b85-ab8f-6e499b55ecfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:12.964221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2890c-18c8-4b85-ab8f-6e499b55ecfc service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:12.964522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2890c-18c8-4b85-ab8f-6e499b55ecfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:12.964948 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2890c-18c8-4b85-ab8f-6e499b55ecfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:12.985275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2890c-18c8-4b85-ab8f-6e499b55ecfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:12.987579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2890c-18c8-4b85-ab8f-6e499b55ecfc service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:13.004061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1231/2449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:13.321127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:13.322766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:13.336939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f7f1f-cbe9-4154-a54e-bee23e0ff6ff None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:13.343068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:13.343762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:13.344152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:13.344458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] PATH_INFO: `/v3/projects/9412ac98893843049e711b3d3aca5d54` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:13.345913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9412ac98893843049e711b3d3aca5d54)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:13.348855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:13.355861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:13.410408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9412ac98893843049e711b3d3aca5d54', 'request_id': 'req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:13.417374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9412ac98893843049e711b3d3aca5d54', 'request_id': 'req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:13.424004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9412ac98893843049e711b3d3aca5d54', 'request_id': 'req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:13.439387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] The token cache is being invalidate because project 9412ac98893843049e711b3d3aca5d54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:20:13.439680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:13.440531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:13.442827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1219/2450] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:20:13 2022] DELETE /identity/v3/projects/9412ac98893843049e711b3d3aca5d54 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:20:14.865081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319c3e5-fbde-4cbf-a190-d17dee6e0559 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:14.865626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319c3e5-fbde-4cbf-a190-d17dee6e0559 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:14.865626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319c3e5-fbde-4cbf-a190-d17dee6e0559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:14.903751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8319c3e5-fbde-4cbf-a190-d17dee6e0559 None None] MFA Rules not processed for user `74711495f0894ebcbee1afeff7ec7ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:14.903751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8319c3e5-fbde-4cbf-a190-d17dee6e0559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:15.021576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1232/2451] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:20.503361 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:20.505498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:20.581912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ca2b7-98e2-4a69-8e9b-bc057c19cac2 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:20.587391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:20.588147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:20.588571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:20.588849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] PATH_INFO: `/v3/users/081d541deff64cfea87850fadc635d97` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:20.590037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=081d541deff64cfea87850fadc635d97)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:20.592080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:20.651428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081d541deff64cfea87850fadc635d97'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:20.661909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081d541deff64cfea87850fadc635d97'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:20.662544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081d541deff64cfea87850fadc635d97'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:20.677567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081d541deff64cfea87850fadc635d97'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:20.678326 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081d541deff64cfea87850fadc635d97'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:20.694335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1220/2452] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:20:20 2022] DELETE /identity/v3/users/081d541deff64cfea87850fadc635d97 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:20.699988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:20.700567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:20.700567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:20.726725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:20.728035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:20.819364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1233/2453] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:20.830099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:20.831641 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:20.855066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:20.921827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12834c-7bab-4590-9301-a81e9ec3bfb7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:20.921827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077af02c-3067-410d-ab73-ace3744aef44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:20.922414 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af02c-3067-410d-ab73-ace3744aef44 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:20.922690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af02c-3067-410d-ab73-ace3744aef44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:20.923106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077af02c-3067-410d-ab73-ace3744aef44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:20.932799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077af02c-3067-410d-ab73-ace3744aef44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:20.934239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077af02c-3067-410d-ab73-ace3744aef44 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:20.944788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1221/2454] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:21.243369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.244859 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:21.258914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2c01ce-f90e-4550-88c9-4e5e46819ef8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.274072 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.275329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.275929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.276249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] PATH_INFO: `/v3/projects/3f0168718ba34fefb27a8d55db1ee6d7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.278384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0168718ba34fefb27a8d55db1ee6d7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.281905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.284928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:21.353197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0168718ba34fefb27a8d55db1ee6d7', 'request_id': 'req-5cfd31ae-f597-434f-ac02-52aabd249827'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:21.360958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0168718ba34fefb27a8d55db1ee6d7', 'request_id': 'req-5cfd31ae-f597-434f-ac02-52aabd249827'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:21.371402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0168718ba34fefb27a8d55db1ee6d7', 'request_id': 'req-5cfd31ae-f597-434f-ac02-52aabd249827'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:21.384984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] The token cache is being invalidate because project 3f0168718ba34fefb27a8d55db1ee6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:20:21.385279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:21.385950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5cfd31ae-f597-434f-ac02-52aabd249827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:21.387833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1234/2455] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:20:21 2022] DELETE /identity/v3/projects/3f0168718ba34fefb27a8d55db1ee6d7 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:21.392453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.392828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.393180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.418845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:21.419217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:21.516824 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1222/2456] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:20:21.525778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.526217 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.526598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.551210 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:21.552581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:21.560885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1235/2457] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:21.565304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.576513 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89605c1e-7d11-4cfe-bf8e-e7d5b5ebe069 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.581498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.582138 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.582449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.582786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.583417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:21.583739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.585430 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.599565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1223/2458] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:21.604081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.614647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ceea0-7a1c-4d3a-b9c0-ab8b72886f04 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.619762 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.620429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.620713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.620977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.621967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.623902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.660140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1236/2459] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:20:21 2022] POST /identity/v3/projects => generated 391 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:20:21.664729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.675746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6f94b-2c47-4f20-82ac-ff67272bf889 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.737860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.738476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.739400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.739657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.740341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.742284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.765804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1224/2460] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:20:21 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:20:21.769846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.781885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba747a2-88d3-401f-8b06-163db8f72e81 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.787658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.788322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.788599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.788869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.789530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.791169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.802466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1237/2461] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:21.806861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.818445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9124669c-f4a0-4b41-98f4-46200e01a6af admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.824188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4cd9d-8bc6-4d01-b929-7df9d4d95241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.824900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4cd9d-8bc6-4d01-b929-7df9d4d95241 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.825165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4cd9d-8bc6-4d01-b929-7df9d4d95241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.825503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4cd9d-8bc6-4d01-b929-7df9d4d95241 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.826242 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4cd9d-8bc6-4d01-b929-7df9d4d95241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.828177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4cd9d-8bc6-4d01-b929-7df9d4d95241 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.840679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1225/2462] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:20:21.845702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:21.856820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154d3f2-fb6f-4f8d-9d95-2df132c53ba9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:21.861574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:21.862254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.862530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.862803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] PATH_INFO: `/v3/projects/10d9554df5274e1ea429f5190c4a9132/users/2cb498621f3d401eb4352cc78707fe6e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.879214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d9554df5274e1ea429f5190c4a9132, user_id=2cb498621f3d401eb4352cc78707fe6e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:21.881983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:21.896964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1238/2463] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:20:21 2022] PUT /identity/v3/projects/10d9554df5274e1ea429f5190c4a9132/users/2cb498621f3d401eb4352cc78707fe6e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:21.908656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:21.908943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:21.909217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:21.947603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] MFA Rules not processed for user `2cb498621f3d401eb4352cc78707fe6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:21.949515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:21.960101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:22.025209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1226/2464] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:22.041773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:22.045641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:22.109028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28265db6-da43-47db-a0f7-c3a4ae2002fc admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:22.112924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e113178-a396-43b1-b0bd-82c95fe79fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:22.113540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113178-a396-43b1-b0bd-82c95fe79fca service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:22.114308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113178-a396-43b1-b0bd-82c95fe79fca service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:22.114580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e113178-a396-43b1-b0bd-82c95fe79fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:22.124104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e113178-a396-43b1-b0bd-82c95fe79fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:22.125625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e113178-a396-43b1-b0bd-82c95fe79fca service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:22.136188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1239/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:32.023094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=22 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:32.131680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=76,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:32.467307 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:32.579030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d241050-ef1a-4bf9-aafe-2661e8fec521 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:32.598905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:32.598905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:32.598905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:32.598905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] PATH_INFO: `/v3/users/2cb498621f3d401eb4352cc78707fe6e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:32.599523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb498621f3d401eb4352cc78707fe6e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:32.599523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:32.663713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb498621f3d401eb4352cc78707fe6e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:32.675703 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb498621f3d401eb4352cc78707fe6e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:32.677156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb498621f3d401eb4352cc78707fe6e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:32.699970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb498621f3d401eb4352cc78707fe6e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:32.701550 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb498621f3d401eb4352cc78707fe6e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:32.727706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1227/2466] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:20:32 2022] DELETE /identity/v3/users/2cb498621f3d401eb4352cc78707fe6e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:20:32.732203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:32.732622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:32.733015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:32.753652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:32.755068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:32.840279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1240/2467] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:32.855676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:32.857454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:32.934023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99467c28-108a-4903-ab51-5ffae34eab1c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:32.937894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3399bf0-ec21-44c8-8bec-37a59c1f52d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:32.938510 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399bf0-ec21-44c8-8bec-37a59c1f52d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:32.938791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399bf0-ec21-44c8-8bec-37a59c1f52d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:32.939065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3399bf0-ec21-44c8-8bec-37a59c1f52d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:32.950207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399bf0-ec21-44c8-8bec-37a59c1f52d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:32.952873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3399bf0-ec21-44c8-8bec-37a59c1f52d0 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:32.968849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1228/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:33.230507 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.232193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:33.244241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed886731-b58b-40b4-8838-e721a15b96ac None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.249757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.250388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.250714 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.250990 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] PATH_INFO: `/v3/projects/10d9554df5274e1ea429f5190c4a9132` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.252140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d9554df5274e1ea429f5190c4a9132)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.254087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.306183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d9554df5274e1ea429f5190c4a9132', 'request_id': 'req-104f44f1-a927-41c9-a28e-a7e1790e1497'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:33.312448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d9554df5274e1ea429f5190c4a9132', 'request_id': 'req-104f44f1-a927-41c9-a28e-a7e1790e1497'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:33.320371 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d9554df5274e1ea429f5190c4a9132', 'request_id': 'req-104f44f1-a927-41c9-a28e-a7e1790e1497'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:33.333000 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] The token cache is being invalidate because project 10d9554df5274e1ea429f5190c4a9132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:20:33.333318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:33.334044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-104f44f1-a927-41c9-a28e-a7e1790e1497 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:20:33.335939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1241/2469] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:20:33 2022] DELETE /identity/v3/projects/10d9554df5274e1ea429f5190c4a9132 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:33.340383 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.340868 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.341129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.361369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:33.362415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:33.383441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:33.437311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1229/2470] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:33.447774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.447774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.447774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.476644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:33.477848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:33.486925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1242/2471] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:33.491449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.508072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7cd-0d1c-4b5f-8f8b-513b29f8fa96 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.513185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.513934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.514215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.514639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.515308 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:20:33.515609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.517254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.531005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1230/2472] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:20:33.535132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.545601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f31dd-22f2-4d03-9889-ab6fcddd9a6f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.550750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.552100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.552485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.552858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.553608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.555693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.591510 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1243/2473] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:20:33 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:20:33.593079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.610987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea3bb-4870-4153-90ba-eeb33f74400a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.676626 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.677253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.677546 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.678352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.678465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.680357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.702010 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1231/2474] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:20:33 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:20:33.706233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.716680 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c8d44-2035-43b9-b396-135360519904 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.722131 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.723271 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.723551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.723818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.724497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.726181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.737995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1244/2475] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:33.742624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.753054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e04229-f892-495b-92d2-33c4957f724b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.758615 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccbfef-3ff0-4d0f-be40-180bbda2a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.759224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccbfef-3ff0-4d0f-be40-180bbda2a734 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.759498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccbfef-3ff0-4d0f-be40-180bbda2a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.759819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccbfef-3ff0-4d0f-be40-180bbda2a734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.760502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccbfef-3ff0-4d0f-be40-180bbda2a734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.762087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccbfef-3ff0-4d0f-be40-180bbda2a734 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.773573 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1232/2476] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:33.778075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.789497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce9149-1111-4b12-818f-4d3c55537b3b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.794922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.795589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.795888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.796172 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] PATH_INFO: `/v3/projects/94a3063020764db192a3e6b25082fd66/users/722f2173a5cc46e4ad7fa92aafdcdc6e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.812113 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=94a3063020764db192a3e6b25082fd66, user_id=722f2173a5cc46e4ad7fa92aafdcdc6e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:33.814835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:33.831316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1245/2477] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:20:33 2022] PUT /identity/v3/projects/94a3063020764db192a3e6b25082fd66/users/722f2173a5cc46e4ad7fa92aafdcdc6e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:33.836624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1be62-df65-48c5-ae99-ceff39d42d3d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.836961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1be62-df65-48c5-ae99-ceff39d42d3d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.837328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1be62-df65-48c5-ae99-ceff39d42d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:33.857066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-3dc1be62-df65-48c5-ae99-ceff39d42d3d None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:33.858374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3dc1be62-df65-48c5-ae99-ceff39d42d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:33.920145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1233/2478] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:33.930226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:33.931894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:33.956746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:33.993033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596876a-821d-4303-ab99-5b945d1aa07b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:33.996752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:33.997366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:33.997628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:33.997900 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:34.008534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:34.010951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:34.022019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1246/2479] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:39.265786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.266246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.266526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.304008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] MFA Rules not processed for user `722f2173a5cc46e4ad7fa92aafdcdc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:39.305240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:39.330140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:39.400096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1234/2480] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:39.403158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:39.413883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20112c7e-a969-4647-841c-4c8e0e14e6d3 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:39.419640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:39.420465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.420815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.421154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.421888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:39.423880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:39.460557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1247/2481] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:20:39 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:20:39.464656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:39.477725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb6aac-2ae1-4617-9d5b-06abd48d49ae None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:39.556070 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:39.556708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.556984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.557503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.558161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:39.560208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:39.584446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1235/2482] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:20:39 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:20:39.588535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:39.599430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e26e5e-3299-4469-bfd6-e32c49c123ac admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:39.603893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:39.604631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.605023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.605307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.605982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:39.607632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:39.618647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1248/2483] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:39.622836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:39.634001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66771f-d9b4-471b-b3f9-5d420fb4f8e9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:39.640145 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:39.640822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.641104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.641381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] PATH_INFO: `/v3/projects/76e2271a65be4b99aa66e2a1ee38f964/users/387f29ce456646cebf90f1b4ca8ee163/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.657706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e2271a65be4b99aa66e2a1ee38f964, user_id=387f29ce456646cebf90f1b4ca8ee163, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:39.660478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:39.675100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1236/2484] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:20:39 2022] PUT /identity/v3/projects/76e2271a65be4b99aa66e2a1ee38f964/users/387f29ce456646cebf90f1b4ca8ee163/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:39.678906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:39.690332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77243ed1-8591-44ea-9419-d022616b1fd7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:39.757636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f633dd1-de21-4388-95e3-97a17d9bec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:39.758252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f633dd1-de21-4388-95e3-97a17d9bec36 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.758533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f633dd1-de21-4388-95e3-97a17d9bec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.758801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f633dd1-de21-4388-95e3-97a17d9bec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.759447 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f633dd1-de21-4388-95e3-97a17d9bec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:39.761133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f633dd1-de21-4388-95e3-97a17d9bec36 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:39.773484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1249/2485] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:20:39.777512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:39.790102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282773f-70b9-4b70-9495-057dfedbb865 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:39.795886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:39.796604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:39.796883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:39.797155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] PATH_INFO: `/v3/projects/76e2271a65be4b99aa66e2a1ee38f964/users/387f29ce456646cebf90f1b4ca8ee163/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:39.799260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e2271a65be4b99aa66e2a1ee38f964, user_id=387f29ce456646cebf90f1b4ca8ee163, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:39.802746 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:39.814013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1237/2486] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:20:39 2022] PUT /identity/v3/projects/76e2271a65be4b99aa66e2a1ee38f964/users/387f29ce456646cebf90f1b4ca8ee163/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:20:40.799710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4149-994a-46f2-97e7-a8f4f19dfbf8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:40.800257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4149-994a-46f2-97e7-a8f4f19dfbf8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:40.800257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf4149-994a-46f2-97e7-a8f4f19dfbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:40.861094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-eebf4149-994a-46f2-97e7-a8f4f19dfbf8 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:40.862456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-eebf4149-994a-46f2-97e7-a8f4f19dfbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:41.002025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1250/2487] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 31 12:20:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:41.019077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:41.020988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:41.147212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433c0e1-66da-48b3-ace0-e174f9e70fd8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:41.154260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:41.155170 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:41.156169 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:41.156630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:41.169136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:41.171476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:41.179602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:41.196283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1238/2488] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:20:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 12:20:45.314655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51b77-fcd0-4c59-9f8b-c5bb715cea0e None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:45.315124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51b77-fcd0-4c59-9f8b-c5bb715cea0e None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:45.315221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a51b77-fcd0-4c59-9f8b-c5bb715cea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:45.349185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-76a51b77-fcd0-4c59-9f8b-c5bb715cea0e None None] MFA Rules not processed for user `387f29ce456646cebf90f1b4ca8ee163`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:45.350849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-76a51b77-fcd0-4c59-9f8b-c5bb715cea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:45.373772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:20:45.434279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1251/2489] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:45.449507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:45.451269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:45.551483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9e878-0a4a-4c9f-8873-87eed00cd58e service swift] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:45.557564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e01068f-034e-49fa-a1ad-76d803910d58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:45.559914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01068f-034e-49fa-a1ad-76d803910d58 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:45.560295 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01068f-034e-49fa-a1ad-76d803910d58 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:45.560646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e01068f-034e-49fa-a1ad-76d803910d58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:45.622432 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01068f-034e-49fa-a1ad-76d803910d58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:45.624121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e01068f-034e-49fa-a1ad-76d803910d58 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:45.633475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1239/2490] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:20:46.858139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:46.858677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:46.858760 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:46.880030 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] MFA Rules not processed for user `722f2173a5cc46e4ad7fa92aafdcdc6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:46.881278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:46.888550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1252/2491] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:20:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:48.052695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2d47f-e5b8-4f60-ab29-71e294774c05 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:48.053196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2d47f-e5b8-4f60-ab29-71e294774c05 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:48.053196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2d47f-e5b8-4f60-ab29-71e294774c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:48.082504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-faf2d47f-e5b8-4f60-ab29-71e294774c05 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:48.083883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-faf2d47f-e5b8-4f60-ab29-71e294774c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:48.181345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1240/2492] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:48.214657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:48.216300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:48.232791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb68673-e88b-4099-bd94-fe1c0a31743f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:48.244448 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:48.245090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:48.245425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:48.245902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:48.255793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:48.257421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:48.270724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1253/2493] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:52.359648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca815d-7bd5-4bba-adb8-69f1bbd6b07a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:52.360229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca815d-7bd5-4bba-adb8-69f1bbd6b07a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:52.360229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca815d-7bd5-4bba-adb8-69f1bbd6b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:52.380837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-56ca815d-7bd5-4bba-adb8-69f1bbd6b07a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:52.382047 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-56ca815d-7bd5-4bba-adb8-69f1bbd6b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:52.390627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1241/2494] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:52.420315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:52.432410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c591b0b-408c-449c-ab4f-9bbb5056ead6 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:52.438490 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:52.439102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:52.439375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:52.439643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:52.448350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:52.450165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:52.459343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1254/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:20:56.473246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12495-a5f6-417f-9e87-eb847a8591b3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:56.473899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12495-a5f6-417f-9e87-eb847a8591b3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:56.473899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d12495-a5f6-417f-9e87-eb847a8591b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:56.497535 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-42d12495-a5f6-417f-9e87-eb847a8591b3 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:20:56.498785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-42d12495-a5f6-417f-9e87-eb847a8591b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:20:56.507464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1242/2496] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:20:56.542717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:20:56.553870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38cb13-a911-418f-8bbc-78d46cc4a6aa service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:20:56.559876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:20:56.560506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:20:56.560789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:20:56.561057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:20:56.569800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:20:56.571387 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:20:56.584289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1255/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:01.688329 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351dbf2-9695-48c1-8bbb-a7786c39e01a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:01.688938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351dbf2-9695-48c1-8bbb-a7786c39e01a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:01.688938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351dbf2-9695-48c1-8bbb-a7786c39e01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:01.709449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f351dbf2-9695-48c1-8bbb-a7786c39e01a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:01.710647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f351dbf2-9695-48c1-8bbb-a7786c39e01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:01.718766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1243/2498] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:01.743272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:01.755572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acddc3-4e3d-4f6c-b407-e70d72a80e09 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:01.761171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:01.761766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:01.762052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:01.762312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:01.770919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:01.772536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:01.782220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1256/2499] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:07.988622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:07.989143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:07.989392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:08.010962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:08.013373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:08.021292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1244/2500] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 31 12:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:08.043150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:08.054765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335655f5-2e42-491a-b92d-5180ea910fe1 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:08.060388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:08.061077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:08.061435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:08.061708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:08.071109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:08.072879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:08.082958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1257/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:18.005434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:18.078641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=53 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:26.433100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:26.437456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:26.514151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad927470-6c34-411e-ae15-79aa2b2c6e32 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:26.520680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:26.521134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:26.521436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:26.521895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:26.532837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:26.534389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:26.549618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1245/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:21:31.041593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:31.051117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76167f6f-d0fc-4aad-b8b2-140cf8d9bbc6 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:31.054941 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:31.055526 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:31.055800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:31.056099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:31.058011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:31.074272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:31.076483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:31.088358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1258/2503] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:21:32.269469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:32.279276 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36725f6-ae66-4439-a1d1-59e6c70c9154 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:32.283341 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:32.283938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:32.284255 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:32.284523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:32.286246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:32.300436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:32.301856 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:32.312878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1246/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:21:41.083415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:42.308122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=32 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:46.628029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:46.639777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04e56e-9472-4e40-9b29-ac020cdb130a service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:46.645764 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:46.646375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:46.646645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:46.646907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:46.648770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:46.746162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:46.747927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:46.761562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1259/2505] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:21:46.847203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:46.850159 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:46.884752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36d2af7-8153-4f76-8422-27d1fdb3a7eb service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:46.889439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:46.890069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:46.890375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:46.890600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] PATH_INFO: `/v3/users/74711495f0894ebcbee1afeff7ec7ff4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:46.891866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74711495f0894ebcbee1afeff7ec7ff4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:46.894008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:46.964002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74711495f0894ebcbee1afeff7ec7ff4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:46.973611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74711495f0894ebcbee1afeff7ec7ff4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:46.974325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74711495f0894ebcbee1afeff7ec7ff4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:46.991161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74711495f0894ebcbee1afeff7ec7ff4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:46.992166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-38d16678-d333-480e-94e3-df867e0463a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74711495f0894ebcbee1afeff7ec7ff4'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:47.005945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1247/2506] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:21:46 2022] DELETE /identity/v3/users/74711495f0894ebcbee1afeff7ec7ff4 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:21:47.204638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:47.231279 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a71359-342f-4315-bafe-b6bb1026576e service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:47.311707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:47.312644 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:47.312986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:47.313168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] PATH_INFO: `/v3/projects/23d34fe64b374039bba7a2a3d7940df1` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:47.314554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d34fe64b374039bba7a2a3d7940df1)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:47.316992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:47.374521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d34fe64b374039bba7a2a3d7940df1', 'request_id': 'req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:47.383292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d34fe64b374039bba7a2a3d7940df1', 'request_id': 'req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:47.393395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d34fe64b374039bba7a2a3d7940df1', 'request_id': 'req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:47.411412 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] The token cache is being invalidate because project 23d34fe64b374039bba7a2a3d7940df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:21:47.411716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:47.412382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:21:47.413983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1260/2507] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:21:47 2022] DELETE /identity/v3/projects/23d34fe64b374039bba7a2a3d7940df1 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:21:49.380838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:49.381362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:49.381487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:49.401374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] MFA Rules not processed for user `d452a433fe3d45018e247cc9424cafbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:21:49.402577 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:49.478052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1248/2508] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:21:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:21:56.254608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:21:56.256734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:56.301295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:21:56.330204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da4ccc-5fb1-4ee7-9f4e-b483ffd2cb05 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:21:56.334851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:21:56.336924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:21:56.339771 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:21:56.340738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:21:56.343091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:21:56.353501 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:21:56.354953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:21:56.373575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1261/2509] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:21:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:21:59.468964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:00.750973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:00.753622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:00.849024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73ae26-c841-4425-a142-d2d1289deb21 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:00.854864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:00.855488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:00.855769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:00.856077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:00.857901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:00.922564 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:00.924685 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d7c1c-d1f9-40bc-9e80-40b683eeac48 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:00.937523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1249/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:22:06.078875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:06.093736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a63f8c4-0319-404d-8762-76c0919a4f8b service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:06.104998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:06.105970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:06.106602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:06.107086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:06.111492 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:06.132861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:06.135787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:06.155894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1262/2511] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:10.325020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:10.325723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:10.325723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:10.345865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] MFA Rules not processed for user `8fd40d2528354adcad63e59310cbfad3`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:10.347141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:10.354675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1250/2512] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:22:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:22:10.765435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:10.768320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:10.786240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3548ee2-0243-40c2-9052-ba052acb8dbc service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:10.790477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:10.791191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:10.791563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:10.791932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:10.794324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:10.806187 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:10.807724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:10.816914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1263/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:11.187485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:11.190166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:11.284134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088ac48-f420-43a1-b9ec-ae3ff98fd628 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:11.289270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:11.289881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:11.290160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:11.290428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:11.292236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:11.304445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:11.306032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47cfa2-5c00-4d2c-9c0b-9114618dd8cc service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:11.316382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1251/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:20.812540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=25 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:21.191636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:21.194851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:21.226988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1dbcea-1f99-47b3-a528-d8582e5ceb03 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:21.234203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:21.235622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:21.235924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:21.236241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:21.238426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:21.255154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:21.257672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:21.273094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1264/2515] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:21.311864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:31.267552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:44.131027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:44.131727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:44.132055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:44.163447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:22:44.165508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:44.238105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1252/2516] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 31 12:22:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:22:44.306373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:44.308738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:44.443121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af48f3b-b6e2-4b3e-8ed6-3883e01240bf service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:44.448869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:44.449856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:44.450175 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:44.450498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:44.460573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:44.462515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:44.472266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1265/2517] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:22:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:22:49.463074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:49.486887 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135c94-ccb5-43a8-9cd9-92a90db44574 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:49.495693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:49.496801 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:49.497299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:49.497770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:49.501325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:49.514763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:49.516638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:49.553642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1253/2518] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:53.363200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:53.383027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89a2b1-e366-4ae8-a6f8-4e35140097ee service swift] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:53.392311 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:53.393476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:53.394067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:53.394594 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:53.397635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:53.417669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:53.419327 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:53.433127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1266/2519] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:22:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:22:53.450930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:53.455034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:53.548715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32350f-ebf6-4791-a1c7-16cd175d19f5 service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:53.556081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:53.557125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:53.557597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:53.558051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] PATH_INFO: `/v3/users/e0ad527ed1644497a08e85c7e0b59ac6` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:53.559880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ad527ed1644497a08e85c7e0b59ac6)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:53.563559 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:53.637749 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ad527ed1644497a08e85c7e0b59ac6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:53.650125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ad527ed1644497a08e85c7e0b59ac6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:53.651158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ad527ed1644497a08e85c7e0b59ac6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:53.672431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ad527ed1644497a08e85c7e0b59ac6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:53.673539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ad527ed1644497a08e85c7e0b59ac6'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:53.695013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1254/2520] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:22:53 2022] DELETE /identity/v3/users/e0ad527ed1644497a08e85c7e0b59ac6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:22:53.924635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:53.944056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5cef62-c096-451d-862f-e88c9fcfa242 service placement] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:54.040828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:54.041604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.041940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.042249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] PATH_INFO: `/v3/projects/f145c1a7a27b4a6aa9f366a814ee4a12` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.043484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f145c1a7a27b4a6aa9f366a814ee4a12)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:54.045704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:54.106571 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f145c1a7a27b4a6aa9f366a814ee4a12', 'request_id': 'req-18606be7-9982-4352-a0e7-299537701be0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.116032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f145c1a7a27b4a6aa9f366a814ee4a12', 'request_id': 'req-18606be7-9982-4352-a0e7-299537701be0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.125486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f145c1a7a27b4a6aa9f366a814ee4a12', 'request_id': 'req-18606be7-9982-4352-a0e7-299537701be0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.137632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] The token cache is being invalidate because project f145c1a7a27b4a6aa9f366a814ee4a12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:22:54.138005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.138823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.140970 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1267/2521] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:22:53 2022] DELETE /identity/v3/projects/f145c1a7a27b4a6aa9f366a814ee4a12 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:22:54.145738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:54.147227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:54.161004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949c741-2884-49fa-b878-7efd84ade40e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:54.169744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:54.227762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:54.228434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.228709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.228989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] PATH_INFO: `/v3/users/57de8052390e49e198809afc336b7d1a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.230225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57de8052390e49e198809afc336b7d1a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:54.232773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:54.291491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57de8052390e49e198809afc336b7d1a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.300754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57de8052390e49e198809afc336b7d1a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.301666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57de8052390e49e198809afc336b7d1a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.317938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57de8052390e49e198809afc336b7d1a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.318682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57de8052390e49e198809afc336b7d1a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.339441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1255/2522] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:22:54 2022] DELETE /identity/v3/users/57de8052390e49e198809afc336b7d1a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:22:54.588677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:22:54.591577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:22:54.613640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18606be7-9982-4352-a0e7-299537701be0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:22:54.622625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:22:54.714551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:22:54.715356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:22:54.715845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:22:54.716216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] PATH_INFO: `/v3/projects/4145d6862221436793e767d9ee1e32ad` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:22:54.717433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4145d6862221436793e767d9ee1e32ad)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:22:54.720074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:22:54.771227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4145d6862221436793e767d9ee1e32ad', 'request_id': 'req-5a97df62-8f64-4089-a653-9dabcbc8d2c5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.779147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4145d6862221436793e767d9ee1e32ad', 'request_id': 'req-5a97df62-8f64-4089-a653-9dabcbc8d2c5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.788849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4145d6862221436793e767d9ee1e32ad', 'request_id': 'req-5a97df62-8f64-4089-a653-9dabcbc8d2c5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.809100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] The token cache is being invalidate because project 4145d6862221436793e767d9ee1e32ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:22:54.809618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.810546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:22:54.812158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1268/2523] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:22:54 2022] DELETE /identity/v3/projects/4145d6862221436793e767d9ee1e32ad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:23:04.332705 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:04.798542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:21.356841 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:21.359762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:21.431356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1007d3e-f9cf-4d1a-8acf-9c74b27d80b4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:21.481822 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:21.482347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:21.482630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:21.482920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:21.484858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:21.574192 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:21.575975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:21.588407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1256/2524] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:25.010776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.012835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:25.031860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97df62-8f64-4089-a653-9dabcbc8d2c5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.037907 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.038583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.038869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.039144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] PATH_INFO: `/v3/users/d452a433fe3d45018e247cc9424cafbe` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.040335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d452a433fe3d45018e247cc9424cafbe)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.042283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.098141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd452a433fe3d45018e247cc9424cafbe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.106999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd452a433fe3d45018e247cc9424cafbe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.107614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd452a433fe3d45018e247cc9424cafbe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.108239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd452a433fe3d45018e247cc9424cafbe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.120840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-603eb120-8f43-4380-a2de-e56611c73a93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd452a433fe3d45018e247cc9424cafbe'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.133031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1269/2525] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:23:25 2022] DELETE /identity/v3/users/d452a433fe3d45018e247cc9424cafbe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:23:25.308435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.319136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f473-e5d4-4a65-aaa8-bc09cb9b6ff1 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.379893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.380574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.380876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.381134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] PATH_INFO: `/v3/projects/d536385d0b5f4b878c287d4aa158e7e5` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.382286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d536385d0b5f4b878c287d4aa158e7e5)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.384253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.392701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:25.432115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd536385d0b5f4b878c287d4aa158e7e5', 'request_id': 'req-72772011-a5c2-4906-9cb9-8690d8df7f6a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.437894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd536385d0b5f4b878c287d4aa158e7e5', 'request_id': 'req-72772011-a5c2-4906-9cb9-8690d8df7f6a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.444056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd536385d0b5f4b878c287d4aa158e7e5', 'request_id': 'req-72772011-a5c2-4906-9cb9-8690d8df7f6a'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.456855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] The token cache is being invalidate because project d536385d0b5f4b878c287d4aa158e7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:23:25.457146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.457743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-72772011-a5c2-4906-9cb9-8690d8df7f6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:23:25.459267 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1257/2526] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:23:25 2022] DELETE /identity/v3/projects/d536385d0b5f4b878c287d4aa158e7e5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:23:25.464470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.464783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.465058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.485801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:25.487019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:25.544357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1270/2527] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:25.552733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.553091 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.553368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.572810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:25.574007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:25.582518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1258/2528] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:25.587681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.598105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c91037-e9c9-4ae5-8a98-c88e28ce164b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.602656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.603247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.603527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.603793 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.604459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:23:25.604755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.606354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.618026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1271/2529] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:23:25.622415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.632553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999d8ea-5f92-401a-bc1b-871eb6f3fd84 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.637142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.637739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.638017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.638310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.639427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.641359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.668384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1259/2530] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:23:25 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:23:25.672689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.682823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b334922-c4d6-4be5-9a66-39faf2142474 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.745169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.745774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.746060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.746315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.746953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.749514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.757695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:25.772987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1272/2531] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:23:25 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:23:25.777203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.787541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67440862-bbdd-4eb8-85bc-fecad4559124 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.792129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.792722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.792996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.793263 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.793894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.796000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.805748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1260/2532] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:23:25.810155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.821514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c19c464-aad5-493d-bd6e-f72390b3992a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.828127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db25299-52c5-46b5-884e-3c4982c96199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.828747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25299-52c5-46b5-884e-3c4982c96199 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.829037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25299-52c5-46b5-884e-3c4982c96199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.829301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db25299-52c5-46b5-884e-3c4982c96199 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.829956 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db25299-52c5-46b5-884e-3c4982c96199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.831564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db25299-52c5-46b5-884e-3c4982c96199 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.843164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1273/2533] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:23:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:23:25.847488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:25.857686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c318e8-ca83-4177-97e8-785f4a9786b7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:25.862903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:25.863554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.863832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.864141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] PATH_INFO: `/v3/projects/53c5c16a2f064e3c801a200197e8a7ce/users/e4585bb4f69f416d9f46214ae4126961/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.878534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53c5c16a2f064e3c801a200197e8a7ce, user_id=e4585bb4f69f416d9f46214ae4126961, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:25.881223 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:25.895992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1261/2534] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:23:25 2022] PUT /identity/v3/projects/53c5c16a2f064e3c801a200197e8a7ce/users/e4585bb4f69f416d9f46214ae4126961/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:23:25.901443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2a31-ef72-4d4d-b4e1-4f4b538797d4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:25.901728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2a31-ef72-4d4d-b4e1-4f4b538797d4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:25.901995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb2a31-ef72-4d4d-b4e1-4f4b538797d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:25.922227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-3feb2a31-ef72-4d4d-b4e1-4f4b538797d4 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:25.923356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-3feb2a31-ef72-4d4d-b4e1-4f4b538797d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:25.991032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1274/2535] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:23:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:26.001251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:26.003104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:26.061390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185257da-1e9c-4ffa-8543-574d287572e8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:26.065090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:26.065699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:26.065981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:26.066253 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:26.075802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:26.077900 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:26.087788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1262/2536] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:30.386223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:30.386223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:30.386223 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:30.440741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] MFA Rules not processed for user `e4585bb4f69f416d9f46214ae4126961`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:30.440741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:30.523259 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1275/2537] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:30.543335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:30.546229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:30.592699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:30.640741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8248c81-c357-4e92-a171-41fc61e394a2 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:30.646869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f4983-a6d6-42af-9e15-4d9f90d1ce81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:30.647759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4983-a6d6-42af-9e15-4d9f90d1ce81 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:30.648095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4983-a6d6-42af-9e15-4d9f90d1ce81 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:30.648373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f4983-a6d6-42af-9e15-4d9f90d1ce81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:30.657988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f4983-a6d6-42af-9e15-4d9f90d1ce81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:30.659654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f4983-a6d6-42af-9e15-4d9f90d1ce81 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:30.670518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1263/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:31.043568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:23:31.045015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:31.150737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953eed4f-b9b3-43ab-9f32-f63717dbeebf None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:23:31.155368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:23:31.156053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:31.156340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:31.156614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:31.158689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:31.196991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:31.260298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:23:31.261918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d3a554-6c67-4878-8881-a57636fd4075 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:23:31.275463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1276/2539] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:23:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:23:32.473106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcf90e-51e3-415b-84d9-afc0a00e820b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:32.473106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcf90e-51e3-415b-84d9-afc0a00e820b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:32.473106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcf90e-51e3-415b-84d9-afc0a00e820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:32.494181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-cabcf90e-51e3-415b-84d9-afc0a00e820b None None] MFA Rules not processed for user `e4585bb4f69f416d9f46214ae4126961`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:32.495404 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-cabcf90e-51e3-415b-84d9-afc0a00e820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:32.502867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1264/2540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:23:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:39.434655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:23:39.435228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:23:39.435228 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:23:39.457050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] MFA Rules not processed for user `cccdcfdf39404cf484e7614254730e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:23:39.458156 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:23:39.465744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1277/2541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:23:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:23:42.487090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=21 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:23:49.448842 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=20 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:07.965334 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076a6c-9fef-428b-ae04-2e61582f6073 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:07.965920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076a6c-9fef-428b-ae04-2e61582f6073 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:07.965920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5076a6c-9fef-428b-ae04-2e61582f6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:07.986437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c5076a6c-9fef-428b-ae04-2e61582f6073 None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:07.988363 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5076a6c-9fef-428b-ae04-2e61582f6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:08.072019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1265/2542] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:24:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:08.136050 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:08.138328 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:08.235171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce243009-826f-4602-a894-dcf3a946f8f6 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:08.241049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81286ce5-fb28-4686-a4de-9b3bbd421a3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:08.241848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81286ce5-fb28-4686-a4de-9b3bbd421a3a service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:08.242122 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81286ce5-fb28-4686-a4de-9b3bbd421a3a service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:08.242380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81286ce5-fb28-4686-a4de-9b3bbd421a3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:08.252569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81286ce5-fb28-4686-a4de-9b3bbd421a3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:08.254515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81286ce5-fb28-4686-a4de-9b3bbd421a3a service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:08.266326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1278/2543] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:24:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:24:18.058928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=25 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:18.260875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=32 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:24.357730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952817ce-a53f-4033-9971-f69fc2fde799 None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.358684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952817ce-a53f-4033-9971-f69fc2fde799 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.358684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952817ce-a53f-4033-9971-f69fc2fde799 None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.359985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1266/2544] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 31 12:24:24.366121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33748b1-730e-4299-bf0e-53097a6c746d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.367100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33748b1-730e-4299-bf0e-53097a6c746d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.367100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33748b1-730e-4299-bf0e-53097a6c746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.427661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c33748b1-730e-4299-bf0e-53097a6c746d None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:24.428962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c33748b1-730e-4299-bf0e-53097a6c746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:24.521583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1279/2545] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:24.539893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952817ce-a53f-4033-9971-f69fc2fde799 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:24.542650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-952817ce-a53f-4033-9971-f69fc2fde799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:24.636584 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952817ce-a53f-4033-9971-f69fc2fde799 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:24.642730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4243b111-edd5-42c1-b4a3-1ad5b92f6f11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8f9c000fb6194cbe8fe70841753c079c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:24.643670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243b111-edd5-42c1-b4a3-1ad5b92f6f11 service glance] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.644157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243b111-edd5-42c1-b4a3-1ad5b92f6f11 service glance] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.644603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4243b111-edd5-42c1-b4a3-1ad5b92f6f11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.661909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243b111-edd5-42c1-b4a3-1ad5b92f6f11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:24.664508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4243b111-edd5-42c1-b4a3-1ad5b92f6f11 service glance] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:24.683454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1267/2546] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:24.759046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b6da8-458f-48fa-8f7f-e9a817e586b4 None None] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.759323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b6da8-458f-48fa-8f7f-e9a817e586b4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.759541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b6da8-458f-48fa-8f7f-e9a817e586b4 None None] PATH_INFO: `/` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.760932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1280/2547] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:24.766880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd928dd-387d-410e-87d7-f93e8848dff3 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.767312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd928dd-387d-410e-87d7-f93e8848dff3 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.767739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd928dd-387d-410e-87d7-f93e8848dff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.798558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0fd928dd-387d-410e-87d7-f93e8848dff3 None None] MFA Rules not processed for user `c6463d56a7e24d088f6c7a1a8e99139e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:24.800275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0fd928dd-387d-410e-87d7-f93e8848dff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:24.807518 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1268/2548] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:24.822265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b6da8-458f-48fa-8f7f-e9a817e586b4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:24.834818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b6da8-458f-48fa-8f7f-e9a817e586b4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:24.839052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc5de4-cfb7-44c9-8129-d25eb85062a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:24.839874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc5de4-cfb7-44c9-8129-d25eb85062a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.840887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc5de4-cfb7-44c9-8129-d25eb85062a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.841159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc5de4-cfb7-44c9-8129-d25eb85062a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.852769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc5de4-cfb7-44c9-8129-d25eb85062a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:24.855331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc5de4-cfb7-44c9-8129-d25eb85062a3 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:24.867626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1281/2549] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:24:24.982591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66f1c-7e85-4785-a964-41bc64865d6d None None] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.983136 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66f1c-7e85-4785-a964-41bc64865d6d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.983417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b66f1c-7e85-4785-a964-41bc64865d6d None None] PATH_INFO: `/` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:24.984915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1269/2550] 10.222.0.48 () {54 vars in 921 bytes} [Wed Aug 31 12:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 31 12:24:24.991520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36db9a-fd8c-4e5c-b002-aa02c4c878ea None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:24.991809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36db9a-fd8c-4e5c-b002-aa02c4c878ea None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:24.992123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36db9a-fd8c-4e5c-b002-aa02c4c878ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:25.026051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5d36db9a-fd8c-4e5c-b002-aa02c4c878ea None None] MFA Rules not processed for user `e1da264bfb8e41589f88d2e84528d92d`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:25.027140 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5d36db9a-fd8c-4e5c-b002-aa02c4c878ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:25.037467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1282/2551] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Aug 31 12:24:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:25.048200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66f1c-7e85-4785-a964-41bc64865d6d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:25.059680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b66f1c-7e85-4785-a964-41bc64865d6d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:25.063221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:25.063810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:25.064125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:25.064399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:25.078581 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:25.080059 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:25.091673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1270/2552] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:29.553141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:29.553667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:29.553667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:29.580149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:29.581852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:29.590857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1283/2553] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Aug 31 12:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:29.606735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:29.619620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ebcfe-2180-4903-a111-19c664c2eef1 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:29.625073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e231d-8340-45b0-b6f7-67866f28474e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:29.625678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e231d-8340-45b0-b6f7-67866f28474e service swift] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:29.625961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e231d-8340-45b0-b6f7-67866f28474e service swift] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:29.626243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e231d-8340-45b0-b6f7-67866f28474e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:29.636102 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e231d-8340-45b0-b6f7-67866f28474e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:29.638208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e231d-8340-45b0-b6f7-67866f28474e service swift] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:29.647107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1271/2554] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 31 12:24:39.569253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=57 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:39.643522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=41 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:24:46.197673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:46.199353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:46.294531 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e0a8e-2529-46e3-a740-7d01a8088b0f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:46.300154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:46.300783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:46.301073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:46.301348 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:46.303166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:46.315218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:46.316862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:46.327700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1284/2555] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:24:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:24:51.934820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02381a-83e0-4845-8bf7-19136b597b2b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:51.935343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02381a-83e0-4845-8bf7-19136b597b2b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:51.935457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02381a-83e0-4845-8bf7-19136b597b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:51.969566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1c02381a-83e0-4845-8bf7-19136b597b2b None None] MFA Rules not processed for user `c06aa3d6bf274e19946f35bf9392fce6`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:24:51.970788 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1c02381a-83e0-4845-8bf7-19136b597b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:24:51.979208 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1272/2556] 10.222.0.48 () {58 vars in 967 bytes} [Wed Aug 31 12:24:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:24:51.995109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:24:52.006322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc687f-c582-4c87-ab4b-432d19820953 service placement] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:24:52.011927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08996d25b2614149a6bc71437c96b135', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:24:52.012550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:24:52.012825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:24:52.013093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:24:52.021320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:24:52.022906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:24:52.031409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1285/2557] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Aug 31 12:24:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 31 12:25:01.955588 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:02.028253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=47 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:23.134323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:23.135446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:23.135446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:23.157551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] MFA Rules not processed for user `e4585bb4f69f416d9f46214ae4126961`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:23.158782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:23.165838 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1273/2558] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:25:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:23.510013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:23.532477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d281456-311a-4ebb-9c69-02a7edcdc942 service swift] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:23.536278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:23.536808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:23.537089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:23.537363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:23.539151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:23.570005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:23.571472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:23.580515 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1286/2559] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:25:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:25:33.151835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:33.576572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=15 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:44.599018 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:44.600463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:44.613038 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d92e11-76de-4b8b-8747-27d8e40f00cc None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:44.616589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:44.617185 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:44.617467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:44.617739 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:44.619532 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:44.654681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:44.656200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:44.676007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1274/2560] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:25:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:25:47.791149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:47.792568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:47.808693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40060901-c7df-462c-8eb1-dec494c8b19a service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:47.813460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:47.814125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:47.814401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:47.814675 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] PATH_INFO: `/v3/users/cccdcfdf39404cf484e7614254730e6d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:47.815824 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cccdcfdf39404cf484e7614254730e6d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:47.817776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:47.869183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cccdcfdf39404cf484e7614254730e6d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:47.877261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cccdcfdf39404cf484e7614254730e6d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:47.877972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cccdcfdf39404cf484e7614254730e6d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:47.878609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cccdcfdf39404cf484e7614254730e6d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:47.895851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d5059a08-ae04-48ab-a73a-0d54e4b67951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cccdcfdf39404cf484e7614254730e6d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:47.911130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1287/2561] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:25:47 2022] DELETE /identity/v3/users/cccdcfdf39404cf484e7614254730e6d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:25:48.101354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.114620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ec6b6-d478-4fc0-8094-4750f6e45e5a service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.185311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.185950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.186391 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.186663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] PATH_INFO: `/v3/projects/7cc6652689c342208bf85021675f27e1` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.188485 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc6652689c342208bf85021675f27e1)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.190511 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.239417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc6652689c342208bf85021675f27e1', 'request_id': 'req-cddc0b66-7fb7-4670-8279-86daee8410ed'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:48.246601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc6652689c342208bf85021675f27e1', 'request_id': 'req-cddc0b66-7fb7-4670-8279-86daee8410ed'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:48.253371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc6652689c342208bf85021675f27e1', 'request_id': 'req-cddc0b66-7fb7-4670-8279-86daee8410ed'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:48.267086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] The token cache is being invalidate because project 7cc6652689c342208bf85021675f27e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:25:48.267522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:48.268194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cddc0b66-7fb7-4670-8279-86daee8410ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:25:48.269713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1275/2562] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:25:48 2022] DELETE /identity/v3/projects/7cc6652689c342208bf85021675f27e1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:25:48.275233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.275514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.275786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.328835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:48.329954 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:48.391077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1288/2563] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:48.403373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.403669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.403995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.425219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:48.426464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:48.435137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1276/2564] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:48.439496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.450144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835116cd-b711-457a-8c7e-9e9b78b51bc7 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.454733 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.455331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.455609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.455884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.456558 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:25:48.456856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.458457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.470021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1289/2565] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:25:48.474534 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.483880 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd0ada-c229-4b71-b983-a42fa5ecfb23 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.488706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.489313 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.489593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.489862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.490493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.492450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.521612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1277/2566] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:25:48 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:25:48.526458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.536725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a7c83e-5111-4d89-8fcc-b7040999e596 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.572087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:48.600042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.600689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.601063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.601427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.602349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.604802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.627227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1290/2567] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:25:48 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:25:48.631571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.643524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60acdd9b-51b9-4029-88e1-5586c5c3a1a5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.648542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.649148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.649435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.649738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.650698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.652487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.662629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1278/2568] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:25:48.666679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.677022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec89ce-c075-4845-9bf4-60ea48f3ee83 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.682453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2b4ab-5efd-4b8b-a9a6-66536c8915b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.683056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2b4ab-5efd-4b8b-a9a6-66536c8915b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.683330 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2b4ab-5efd-4b8b-a9a6-66536c8915b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.683598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2b4ab-5efd-4b8b-a9a6-66536c8915b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.684373 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2b4ab-5efd-4b8b-a9a6-66536c8915b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.686006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d2b4ab-5efd-4b8b-a9a6-66536c8915b7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.697038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1291/2569] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:25:48.701999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.716600 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bfb33-34ab-4d0c-b418-123932d043bb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.721740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.722320 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.722624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.722957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] PATH_INFO: `/v3/projects/3e0f3d96c86e40b9b428ff6e2133cdcf/users/dff0d73251e4483a8d9dd28978c3b62f/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.726721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:48.742692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0f3d96c86e40b9b428ff6e2133cdcf, user_id=dff0d73251e4483a8d9dd28978c3b62f, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.745966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:48.760847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1279/2570] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:25:48 2022] PUT /identity/v3/projects/3e0f3d96c86e40b9b428ff6e2133cdcf/users/dff0d73251e4483a8d9dd28978c3b62f/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:25:48.773173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.773476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.773708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.806710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] MFA Rules not processed for user `dff0d73251e4483a8d9dd28978c3b62f`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:48.807940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:48.887799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1292/2571] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:25:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:48.899609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:48.973820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e6ef7-acb0-4566-a228-bd79c7425ab0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:48.979328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:48.979939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:48.980241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:48.980516 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:48.981167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:48.983094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.013259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1280/2572] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:25:48 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:25:49.018868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:49.031984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f5c4f-6fe0-4834-9e71-64430042d344 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:49.097092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:49.097700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.097975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.098243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.098875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:49.100843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.124202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1293/2573] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:25:49 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:25:49.129797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:49.140999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c8bac-81de-4ebc-8cc2-a49d32dacc4c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:49.146634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:49.147252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.147521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.147795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.148460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:49.150995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.164786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1281/2574] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:25:49.169928 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:49.180360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824dbf-cb95-4a24-b4de-88a60994e5d6 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:49.185383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:49.186042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.186324 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.186600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] PATH_INFO: `/v3/projects/8e43731fe1264aaca656940bf32de798/users/ccf928bf4cc24c16af7d764a017cd615/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.202258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e43731fe1264aaca656940bf32de798, user_id=ccf928bf4cc24c16af7d764a017cd615, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:49.205005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.221087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1294/2575] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:25:49 2022] PUT /identity/v3/projects/8e43731fe1264aaca656940bf32de798/users/ccf928bf4cc24c16af7d764a017cd615/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:25:49.226729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:49.237683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd92ff-b04b-4155-b9a4-f104b7a38998 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:49.308422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b78376-62b2-4070-ad9d-bf5bac8659d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:49.309037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b78376-62b2-4070-ad9d-bf5bac8659d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.309311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b78376-62b2-4070-ad9d-bf5bac8659d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.309619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b78376-62b2-4070-ad9d-bf5bac8659d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.310258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b78376-62b2-4070-ad9d-bf5bac8659d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:49.312004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b78376-62b2-4070-ad9d-bf5bac8659d2 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.322778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1282/2576] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:25:49.327307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:49.340257 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e870e977-ade7-4877-b1b4-1bc0a148dc76 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:49.344944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:49.345596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.345874 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.346146 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] PATH_INFO: `/v3/projects/8e43731fe1264aaca656940bf32de798/users/ccf928bf4cc24c16af7d764a017cd615/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.348086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e43731fe1264aaca656940bf32de798, user_id=ccf928bf4cc24c16af7d764a017cd615, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:49.350731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.356428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:49.361974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1295/2577] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:25:49 2022] PUT /identity/v3/projects/8e43731fe1264aaca656940bf32de798/users/ccf928bf4cc24c16af7d764a017cd615/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:25:49.372765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.373049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.373620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.401840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] MFA Rules not processed for user `ccf928bf4cc24c16af7d764a017cd615`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:25:49.402986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:49.446352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:25:49.475541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1283/2578] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:25:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:25:49.486930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:49.488628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:25:49.568866 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6749f-d10e-423d-8913-485c3216eddc admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:49.572522 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:49.573127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:49.573409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:49.573686 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:49.629241 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:49.630688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:49.639530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1296/2579] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:25:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:25:52.254919 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:25:52.265613 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba93e7-0d4f-432a-bd6f-04825fe3282b None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:25:52.269325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b239302-428a-4a9c-ba39-5521028add3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:25:52.270073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239302-428a-4a9c-ba39-5521028add3e service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:25:52.270372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239302-428a-4a9c-ba39-5521028add3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:25:52.271066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b239302-428a-4a9c-ba39-5521028add3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:25:52.282406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b239302-428a-4a9c-ba39-5521028add3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:25:52.282948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b239302-428a-4a9c-ba39-5521028add3e service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:25:52.294332 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1284/2580] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:25:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:25:59.635536 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=58 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:02.289033 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=15 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:04.975480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:05.047529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0752a-e91c-4335-948c-a65d3dcfa856 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:05.052313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:05.052977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:05.053299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:05.053521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] PATH_INFO: `/v3/users/dff0d73251e4483a8d9dd28978c3b62f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:05.054657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff0d73251e4483a8d9dd28978c3b62f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:05.056618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:05.116092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff0d73251e4483a8d9dd28978c3b62f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.129285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff0d73251e4483a8d9dd28978c3b62f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.130035 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff0d73251e4483a8d9dd28978c3b62f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.131185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff0d73251e4483a8d9dd28978c3b62f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.148803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff0d73251e4483a8d9dd28978c3b62f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.163369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1297/2581] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:04 2022] DELETE /identity/v3/users/dff0d73251e4483a8d9dd28978c3b62f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:05.168715 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:05.169198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:05.169286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:05.197080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:05.198597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:05.274453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1285/2582] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:05.285783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:05.287494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:05.349275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3f30-6211-40ea-946b-2fc79d436141 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:05.353649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:05.354264 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:05.354545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:05.354818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:05.364477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:05.366224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:05.376723 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1298/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:05.649719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:05.651161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:05.664661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889119-9b64-46f3-b652-7c08f44bd3de None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:05.673310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:05.673951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:05.674229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:05.674531 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] PATH_INFO: `/v3/projects/3e0f3d96c86e40b9b428ff6e2133cdcf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:05.683622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0f3d96c86e40b9b428ff6e2133cdcf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:05.685609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:05.734654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0f3d96c86e40b9b428ff6e2133cdcf', 'request_id': 'req-66298b2f-27db-4d0e-818a-879a7d4fc229'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.740214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0f3d96c86e40b9b428ff6e2133cdcf', 'request_id': 'req-66298b2f-27db-4d0e-818a-879a7d4fc229'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.747347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0f3d96c86e40b9b428ff6e2133cdcf', 'request_id': 'req-66298b2f-27db-4d0e-818a-879a7d4fc229'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.762105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] The token cache is being invalidate because project 3e0f3d96c86e40b9b428ff6e2133cdcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:05.762409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.763034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.764589 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1286/2584] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:05 2022] DELETE /identity/v3/projects/3e0f3d96c86e40b9b428ff6e2133cdcf => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:05.768726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:05.778460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2890-aa2c-4eba-81d7-098ea9af4719 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:05.796480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:05.840249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:05.840883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:05.841157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:05.841425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] PATH_INFO: `/v3/users/ccf928bf4cc24c16af7d764a017cd615` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:05.842544 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccf928bf4cc24c16af7d764a017cd615)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:05.844532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:05.892207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccf928bf4cc24c16af7d764a017cd615'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.900144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccf928bf4cc24c16af7d764a017cd615'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.900781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccf928bf4cc24c16af7d764a017cd615'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.901429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccf928bf4cc24c16af7d764a017cd615'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.914528 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b02b652c-c3e0-45b2-a6c3-8799ab44c9e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccf928bf4cc24c16af7d764a017cd615'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:05.927433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1299/2585] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:05 2022] DELETE /identity/v3/users/ccf928bf4cc24c16af7d764a017cd615 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:06.207156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.208731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:06.223374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66298b2f-27db-4d0e-818a-879a7d4fc229 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.296542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.297180 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.297486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.297758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] PATH_INFO: `/v3/projects/8e43731fe1264aaca656940bf32de798` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.298886 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e43731fe1264aaca656940bf32de798)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.300835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.335013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:06.356636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e43731fe1264aaca656940bf32de798', 'request_id': 'req-6516fb86-2ebd-46d0-8ec6-555de186cbb7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:06.368638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e43731fe1264aaca656940bf32de798', 'request_id': 'req-6516fb86-2ebd-46d0-8ec6-555de186cbb7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:06.378061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e43731fe1264aaca656940bf32de798', 'request_id': 'req-6516fb86-2ebd-46d0-8ec6-555de186cbb7'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:06.389825 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] The token cache is being invalidate because project 8e43731fe1264aaca656940bf32de798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:06.390132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:06.390800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6516fb86-2ebd-46d0-8ec6-555de186cbb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:06.392505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1287/2586] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:06 2022] DELETE /identity/v3/projects/8e43731fe1264aaca656940bf32de798 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:06.397426 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.397925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.398033 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.425917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:06.427125 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:06.497711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1300/2587] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:06.507478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.507837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.509415 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.530860 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:06.532125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:06.540272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1288/2588] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:06.544931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.554685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24184f-9b7c-44ef-ae46-3e80637b4367 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.559934 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.560572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.560873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.561149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.561798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:06.562109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.563721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.576613 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1301/2589] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:06.581591 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.591601 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede4983-495c-4693-ae76-a22dca61644f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.600477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.601176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.601590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.602110 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.602754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.605127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.641266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1289/2590] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:06 2022] POST /identity/v3/projects => generated 387 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:06.645650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.655702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d79455-92a9-4781-b54d-904267eadd30 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.684360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:06.718542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.719153 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.719435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.719709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.720397 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.722316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.745303 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1302/2591] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:06 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:06.749722 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.761154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea4f24-1c5e-499f-8359-e1792e1c6a7b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.765949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.766557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.766835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.767134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.767772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.769658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.780373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1290/2592] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:06.784518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.794989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515a90e-2128-4635-92df-39052ebbc2c2 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.799858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebde73e-1c69-4b01-aecc-810b20a075da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.800504 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebde73e-1c69-4b01-aecc-810b20a075da admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.800783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebde73e-1c69-4b01-aecc-810b20a075da admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.801055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebde73e-1c69-4b01-aecc-810b20a075da admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.801689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebde73e-1c69-4b01-aecc-810b20a075da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.803329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebde73e-1c69-4b01-aecc-810b20a075da admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.814297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1303/2593] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:06.818758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:06.829162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a72b92-4eef-484a-a408-20c976dcddae admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:06.835057 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:06.835744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.836827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.836827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] PATH_INFO: `/v3/projects/6aa3aaa5e53a49d08494cf0be8f5e35a/users/e8052b64cced4b26953d662970336702/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.851465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa3aaa5e53a49d08494cf0be8f5e35a, user_id=e8052b64cced4b26953d662970336702, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:06.854690 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:06.868913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1291/2594] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:06 2022] PUT /identity/v3/projects/6aa3aaa5e53a49d08494cf0be8f5e35a/users/e8052b64cced4b26953d662970336702/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:06.879209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:06.879499 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:06.879779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:06.907971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] MFA Rules not processed for user `e8052b64cced4b26953d662970336702`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:06.909198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:06.978937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1304/2595] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:06.983451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.045802 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38345248-c6c2-4c2c-a678-7caf5a4ae192 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.050484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.051086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.051366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.051640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.052306 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.054209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.084633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1292/2596] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:06 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:07.085864 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.098147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12648552-c77b-468e-b9c1-9a30a66d2d4b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.158239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.158854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.159136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.159411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.160149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.162137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.187547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1305/2597] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:07 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:07.191611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.202319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c961821-183f-4841-800b-cacf8c759246 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.206982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.207593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.208174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.208174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.209031 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.210417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.222188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1293/2598] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:07.229562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.240294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2eac43-55c1-42b9-8a6e-4f23ed4fa24c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.245067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.245738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.246040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.246315 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] PATH_INFO: `/v3/projects/eecf6b70e07b418ba0aa4481d850dec4/users/893f55ee13c444c5be70cdeaf09a22dc/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.262054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecf6b70e07b418ba0aa4481d850dec4, user_id=893f55ee13c444c5be70cdeaf09a22dc, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.264759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.278484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1306/2599] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:07 2022] PUT /identity/v3/projects/eecf6b70e07b418ba0aa4481d850dec4/users/893f55ee13c444c5be70cdeaf09a22dc/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:07.282716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.293633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f38e0-3e6c-4a38-a1e5-c1bc6ccd18ac admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.313778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:07.353704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc12da-1e18-4eaa-a306-07d68ebcb886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.354315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc12da-1e18-4eaa-a306-07d68ebcb886 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.354593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc12da-1e18-4eaa-a306-07d68ebcb886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.354867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc12da-1e18-4eaa-a306-07d68ebcb886 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.355505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc12da-1e18-4eaa-a306-07d68ebcb886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.357156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc12da-1e18-4eaa-a306-07d68ebcb886 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.369160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1294/2600] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:07.373355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.379059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:07.385446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b113997d-5020-429d-8d41-3ec73e0fbbce admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.390502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.391282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.391718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.392022 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] PATH_INFO: `/v3/projects/eecf6b70e07b418ba0aa4481d850dec4/users/893f55ee13c444c5be70cdeaf09a22dc/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.394176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecf6b70e07b418ba0aa4481d850dec4, user_id=893f55ee13c444c5be70cdeaf09a22dc, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.397199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.412971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1307/2601] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:07 2022] PUT /identity/v3/projects/eecf6b70e07b418ba0aa4481d850dec4/users/893f55ee13c444c5be70cdeaf09a22dc/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:07.424906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.425193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.425497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.453095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] MFA Rules not processed for user `893f55ee13c444c5be70cdeaf09a22dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:07.454304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:07.522867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1295/2602] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:07.535161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.536894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:07.602999 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367afd2-49d8-403c-b0c1-f5249a81591f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.606652 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.607253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.607527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.607792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.617249 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.618775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.629366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1308/2603] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:07.635035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.636529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:07.661040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.698624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15641644-18e9-4e76-a972-1b46331a15a7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.703646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.704370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.704663 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.704936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.706772 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:07.724514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3630ab4-5eee-4ce9-9779-8c316413f7ca service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.729326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.729957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.730237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.730505 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] PATH_INFO: `/v3/users/e8052b64cced4b26953d662970336702` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.731692 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8052b64cced4b26953d662970336702)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.733653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.774580 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:07.778250 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:07.780465 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d2f84d-c197-44fe-93f7-4c04ba57065b service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:07.787525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8052b64cced4b26953d662970336702'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:07.791699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1296/2604] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:07.795369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8052b64cced4b26953d662970336702'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:07.796052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8052b64cced4b26953d662970336702'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:07.796668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8052b64cced4b26953d662970336702'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:07.811409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8052b64cced4b26953d662970336702'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:07.825463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1309/2605] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:07 2022] DELETE /identity/v3/users/e8052b64cced4b26953d662970336702 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:07.829962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.830243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.830558 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:07.850736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:07.852115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:07.915668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1297/2606] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:07.926143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:07.927718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:07.943715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:07.994028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed758670-5c79-48e4-8603-c79ebe6594fd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:07.997809 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:07.998436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:07.998712 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:07.998979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:08.009892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:08.011516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:08.022684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1310/2607] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:08.318315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:08.319736 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:08.332429 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ae8116-8654-4b9f-920f-61294f6d4594 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:08.337636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:08.338278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:08.338555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:08.338829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] PATH_INFO: `/v3/projects/6aa3aaa5e53a49d08494cf0be8f5e35a` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:08.340007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa3aaa5e53a49d08494cf0be8f5e35a)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:08.341928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:08.395454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa3aaa5e53a49d08494cf0be8f5e35a', 'request_id': 'req-9ecbd785-bbdc-48d4-a93a-56add59afd11'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.401708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa3aaa5e53a49d08494cf0be8f5e35a', 'request_id': 'req-9ecbd785-bbdc-48d4-a93a-56add59afd11'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.409143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa3aaa5e53a49d08494cf0be8f5e35a', 'request_id': 'req-9ecbd785-bbdc-48d4-a93a-56add59afd11'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.425286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] The token cache is being invalidate because project 6aa3aaa5e53a49d08494cf0be8f5e35a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:08.425649 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.426385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.431727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1298/2608] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:08 2022] DELETE /identity/v3/projects/6aa3aaa5e53a49d08494cf0be8f5e35a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:08.433220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:08.443167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df323a15-dd56-40d2-b275-c5a55b21a553 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:08.512718 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:08.513367 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:08.513672 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:08.513944 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] PATH_INFO: `/v3/users/893f55ee13c444c5be70cdeaf09a22dc` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:08.515129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=893f55ee13c444c5be70cdeaf09a22dc)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:08.517162 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:08.566785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '893f55ee13c444c5be70cdeaf09a22dc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.574384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '893f55ee13c444c5be70cdeaf09a22dc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.575142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '893f55ee13c444c5be70cdeaf09a22dc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.575784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '893f55ee13c444c5be70cdeaf09a22dc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.589291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a4b4d24f-5bf8-4feb-abfa-6828d93233b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '893f55ee13c444c5be70cdeaf09a22dc'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:08.604109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1311/2609] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:08 2022] DELETE /identity/v3/users/893f55ee13c444c5be70cdeaf09a22dc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:09.043052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.044704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:09.070767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecbd785-bbdc-48d4-a93a-56add59afd11 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.164968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.165666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.165950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.166221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] PATH_INFO: `/v3/projects/eecf6b70e07b418ba0aa4481d850dec4` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.167347 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eecf6b70e07b418ba0aa4481d850dec4)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.169475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.198667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:09.237024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eecf6b70e07b418ba0aa4481d850dec4', 'request_id': 'req-55c6ba28-1ddf-4152-88ba-e076906f0663'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:09.246215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eecf6b70e07b418ba0aa4481d850dec4', 'request_id': 'req-55c6ba28-1ddf-4152-88ba-e076906f0663'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:09.254135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eecf6b70e07b418ba0aa4481d850dec4', 'request_id': 'req-55c6ba28-1ddf-4152-88ba-e076906f0663'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:09.270440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] The token cache is being invalidate because project eecf6b70e07b418ba0aa4481d850dec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:09.270792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:09.271716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-55c6ba28-1ddf-4152-88ba-e076906f0663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:09.274037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1299/2610] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:09 2022] DELETE /identity/v3/projects/eecf6b70e07b418ba0aa4481d850dec4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:09.279016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.279437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.279716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.302622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:09.303828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:09.334819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:09.367527 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1312/2611] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:09.376988 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.377557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.377557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.397883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:09.399647 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:09.408851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1300/2612] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:09.413168 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.425746 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2230bad9-93fb-45e1-b39c-5eea3122abbd None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.431193 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.432092 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.432508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.432909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.433885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:09.434452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.436926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.451870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1313/2613] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:09.456392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.466666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1172141-a0f1-4298-aceb-d16ccb8768dd None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.471617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.472579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.472579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.472945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.473618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.475522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.507869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1301/2614] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:09 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:09.512386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.523018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0297c-205e-4470-9501-6e24223a922b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.590167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.590912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.591194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.591468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.592129 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.594059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.624016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1314/2615] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:09 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:09.629153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.648048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b848b-c78a-4c82-8dcc-da9d4b3aaf87 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.656487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.657467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.657943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.658418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.659543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.662711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.684022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1302/2616] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:09.688356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.704513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc950777-8a14-4e89-9fba-3d860b67e9db admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.709545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d024d-0e18-40e8-81e0-1f6a65b1cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.711305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d024d-0e18-40e8-81e0-1f6a65b1cd45 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.711305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d024d-0e18-40e8-81e0-1f6a65b1cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.711305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d024d-0e18-40e8-81e0-1f6a65b1cd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.711787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d024d-0e18-40e8-81e0-1f6a65b1cd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.713921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d024d-0e18-40e8-81e0-1f6a65b1cd45 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.729939 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1315/2617] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:09.734205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.746165 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34223-ed2c-4b9e-b978-f96178d6bc8e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:09.751323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:09.752161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.752468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.752764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] PATH_INFO: `/v3/projects/d12171c58e7f4870b522cb32e77e4d7c/users/7f2962587173494a81490947255986ec/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.770444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12171c58e7f4870b522cb32e77e4d7c, user_id=7f2962587173494a81490947255986ec, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:09.773201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:09.789203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1303/2618] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:09 2022] PUT /identity/v3/projects/d12171c58e7f4870b522cb32e77e4d7c/users/7f2962587173494a81490947255986ec/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:09.800486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:09.800739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:09.801024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:09.832940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] MFA Rules not processed for user `7f2962587173494a81490947255986ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:09.834188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:09.920909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1316/2619] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:09.922268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:09.998965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e7a26d-ac63-4a6f-9349-d194944856de admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.004061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.004665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.004954 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.005234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.005945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.007990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.050351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1304/2620] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:09 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:10.053988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:10.075059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa286599-b4c3-44dd-b2b2-2b5d25d55ea1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.110857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:10.154689 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.155464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.155817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.156201 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.156946 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.159001 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.194688 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1317/2621] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:10 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:10.199137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:10.213951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133a208-6424-40cb-ab4b-2b5ce9a38e76 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.220480 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.221028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.221309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.221582 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.222237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.224173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.240191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1305/2622] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:10.241449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:10.253126 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae3745-498e-44c1-99df-01722e933fb0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.260755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.261732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.261732 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.262019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] PATH_INFO: `/v3/projects/16bb64c2454e4e7c9ebc5c393fb99436/users/1e623f7669044523950a72938c3d2faf/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.279037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bb64c2454e4e7c9ebc5c393fb99436, user_id=1e623f7669044523950a72938c3d2faf, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.281979 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.298545 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1318/2623] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:10 2022] PUT /identity/v3/projects/16bb64c2454e4e7c9ebc5c393fb99436/users/1e623f7669044523950a72938c3d2faf/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:10.302272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:10.315915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f47b7-232b-4e36-a734-bdb2c7eefe0e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.336910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:10.389992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69e73c-6360-4a42-a9b9-21d1ec98eb1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.390753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e73c-6360-4a42-a9b9-21d1ec98eb1e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.390889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e73c-6360-4a42-a9b9-21d1ec98eb1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.391163 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69e73c-6360-4a42-a9b9-21d1ec98eb1e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.391819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69e73c-6360-4a42-a9b9-21d1ec98eb1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.395618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69e73c-6360-4a42-a9b9-21d1ec98eb1e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.406622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1306/2624] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:10.410561 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:10.421783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5149117-2d7a-48ee-aeb6-e822d4b3a1b4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.426694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.427364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.427654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.427931 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] PATH_INFO: `/v3/projects/16bb64c2454e4e7c9ebc5c393fb99436/users/1e623f7669044523950a72938c3d2faf/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.429909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16bb64c2454e4e7c9ebc5c393fb99436, user_id=1e623f7669044523950a72938c3d2faf, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.433130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.450211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1319/2625] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:10 2022] PUT /identity/v3/projects/16bb64c2454e4e7c9ebc5c393fb99436/users/1e623f7669044523950a72938c3d2faf/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:10.462913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.463209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.463491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.495989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] MFA Rules not processed for user `1e623f7669044523950a72938c3d2faf`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:10.497303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:10.580904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1307/2626] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:10.591631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:10.593381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:10.652918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8942dcd-18f0-4d7d-a3d7-bedde3108d15 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:10.656453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:10.657056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:10.657329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:10.657593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:10.734377 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:10.735839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:10.745835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1320/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:11.600999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:11.602563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:11.676093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43a219-d2a1-479b-b6f5-a70055f8197c None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:11.683212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:11.683869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:11.684182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:11.684454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] PATH_INFO: `/v3/users/8fd40d2528354adcad63e59310cbfad3` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:11.685624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd40d2528354adcad63e59310cbfad3)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:11.687625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:11.739330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:11.743139 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd40d2528354adcad63e59310cbfad3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:11.751701 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd40d2528354adcad63e59310cbfad3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:11.752316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd40d2528354adcad63e59310cbfad3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:11.765906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd40d2528354adcad63e59310cbfad3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:11.766817 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3e85b8df-a181-43a0-9870-de1d3acc82e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd40d2528354adcad63e59310cbfad3'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:11.781473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1308/2628] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:11 2022] DELETE /identity/v3/users/8fd40d2528354adcad63e59310cbfad3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:11.970783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:11.985128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e467e-97a8-4324-9b28-4225c7a23fdf service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.022446 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:12.050150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.050776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.051058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.051326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] PATH_INFO: `/v3/projects/3ed2622aaff54fafa9d438e0152141d3` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.053105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ed2622aaff54fafa9d438e0152141d3)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.055077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.108423 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ed2622aaff54fafa9d438e0152141d3', 'request_id': 'req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:12.114977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ed2622aaff54fafa9d438e0152141d3', 'request_id': 'req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:12.122603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ed2622aaff54fafa9d438e0152141d3', 'request_id': 'req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:12.134508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] The token cache is being invalidate because project 3ed2622aaff54fafa9d438e0152141d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:12.134812 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:12.135488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-b812fa1b-f3f5-4e7d-9c27-f8241f8a227b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:12.137044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1321/2629] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:11 2022] DELETE /identity/v3/projects/3ed2622aaff54fafa9d438e0152141d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:12.142323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.142667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.143008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.167779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:12.169032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:12.230805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1309/2630] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:12.239449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.240130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.240622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.268861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:12.270119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:12.278857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1322/2631] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:12.283970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.295458 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7539c07c-32a5-49e1-a435-4897986c9884 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.302228 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.302933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.303283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.303608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.304576 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:12.304911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.306533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.319085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1310/2632] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:12.324379 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.333981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeaec93-32b6-47aa-bfc2-642e34a83cb0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.339833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.340474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.340775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.341046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.341704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.343640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.372569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1323/2633] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:12 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:12.377000 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.387923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba9037-60f2-4240-9941-20cde7140b74 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.449673 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.450287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.450585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.450862 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.451553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.453545 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.476486 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1311/2634] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:12 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:12.481476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.496592 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eed1a3-7e77-4dd9-b10e-daf876a09ae7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.500772 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.501473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.501862 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.502232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.502938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.504673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.523465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1324/2635] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:12.528211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.538944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416f720-1dc0-4fbd-8b9f-0f18ac4f81b4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.544305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351a040-17c8-4bc5-91f4-47bc2ced0f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.544915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a040-17c8-4bc5-91f4-47bc2ced0f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.545198 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a040-17c8-4bc5-91f4-47bc2ced0f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.545494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351a040-17c8-4bc5-91f4-47bc2ced0f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.546141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351a040-17c8-4bc5-91f4-47bc2ced0f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.547764 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351a040-17c8-4bc5-91f4-47bc2ced0f6b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.568195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1312/2636] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:12.568588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.579012 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89db330-9753-4248-b732-cf348e96e174 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.584497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.585313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.586096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.586096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] PATH_INFO: `/v3/projects/03af9e6caa45413ba8ed1a79ac786eb3/users/3ddca5ce68b640efbc2185028636d71d/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.609368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03af9e6caa45413ba8ed1a79ac786eb3, user_id=3ddca5ce68b640efbc2185028636d71d, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.613305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.637843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1325/2637] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:12 2022] PUT /identity/v3/projects/03af9e6caa45413ba8ed1a79ac786eb3/users/3ddca5ce68b640efbc2185028636d71d/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:12.648245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.649425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.649425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.682011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] MFA Rules not processed for user `3ddca5ce68b640efbc2185028636d71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:12.683315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:12.697393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:12.703331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.705530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:12.756671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1313/2638] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:12.770193 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:12.772236 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:12.772945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951b5e8-8131-4f5d-a8c5-a33b35d51fb8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.776787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.777441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.777791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.778195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.779926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:12.796160 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:12.853170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.854630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.861002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fc0f0b-2b45-4489-85d9-cc6e73b8156d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:12.867450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:12.868763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:12.869086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:12.869410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:12.873390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1326/2639] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:12.879219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:12.881074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:12.891271 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1314/2640] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:15.204297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:15.205740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:15.292164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40adc4-19bd-4ef8-b5c9-6fb4814ca878 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:15.301418 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:15.302599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:15.302932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:15.303395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:15.306013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:15.394453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:15.395896 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28690cc-37ab-434e-8711-c1d147fc3abd service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:15.405924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1327/2641] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:15.732311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:15.807062 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065e30b0-44c6-4262-b45d-a914973c5fc2 service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:15.813092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:15.814182 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:15.814548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:15.816027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] PATH_INFO: `/v3/users/3ddca5ce68b640efbc2185028636d71d` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:15.816388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddca5ce68b640efbc2185028636d71d)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:15.818124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:15.874178 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:15.877229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddca5ce68b640efbc2185028636d71d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:15.887644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddca5ce68b640efbc2185028636d71d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:15.888483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddca5ce68b640efbc2185028636d71d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:15.905419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddca5ce68b640efbc2185028636d71d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:15.906137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddca5ce68b640efbc2185028636d71d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:15.923009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1315/2642] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:15 2022] DELETE /identity/v3/users/3ddca5ce68b640efbc2185028636d71d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:15.927509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:15.927788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:15.928087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:15.947516 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:15.948757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:16.016584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1328/2643] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:16.030151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:16.032386 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:16.099499 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf3b88-8223-4dce-944a-465bb15a8126 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:16.105540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4b10d-685e-4846-b5ef-bc8de2fa1f24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:16.106189 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b10d-685e-4846-b5ef-bc8de2fa1f24 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:16.106467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b10d-685e-4846-b5ef-bc8de2fa1f24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:16.106874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4b10d-685e-4846-b5ef-bc8de2fa1f24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:16.117934 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4b10d-685e-4846-b5ef-bc8de2fa1f24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:16.119392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4b10d-685e-4846-b5ef-bc8de2fa1f24 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:16.130352 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1316/2644] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:16.449710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:16.454840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:16.479959 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6badc-ea78-4b8d-86ed-4be0c31e5a64 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:16.489724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:16.490454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:16.491075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:16.491616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] PATH_INFO: `/v3/projects/03af9e6caa45413ba8ed1a79ac786eb3` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:16.494389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03af9e6caa45413ba8ed1a79ac786eb3)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:16.498059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:16.501063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:16.570082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03af9e6caa45413ba8ed1a79ac786eb3', 'request_id': 'req-8526544c-3264-4f62-bbe8-ce6241173109'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:16.576667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03af9e6caa45413ba8ed1a79ac786eb3', 'request_id': 'req-8526544c-3264-4f62-bbe8-ce6241173109'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:16.585045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03af9e6caa45413ba8ed1a79ac786eb3', 'request_id': 'req-8526544c-3264-4f62-bbe8-ce6241173109'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:16.596830 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] The token cache is being invalidate because project 03af9e6caa45413ba8ed1a79ac786eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:16.597133 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:16.597817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8526544c-3264-4f62-bbe8-ce6241173109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:16.599557 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1329/2645] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:16 2022] DELETE /identity/v3/projects/03af9e6caa45413ba8ed1a79ac786eb3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:16.605345 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:16.605638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:16.605915 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:16.626720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:16.627877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:16.697476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1317/2646] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:16.708654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:16.708798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:16.709123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:16.739713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:16.741224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:16.766060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1330/2647] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:16.767050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:16.784995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a56d45-d0cd-409c-ba6b-0c1318c1602e None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:16.802525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:16.802525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:16.802525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:16.802525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:16.804003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:16.804003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:16.804003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:16.821951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1318/2648] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:16.828651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:16.840221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469cbe5-8b68-431e-a335-0e4522221902 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:16.845726 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:16.846770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:16.846770 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:16.847111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:16.847573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:16.850640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:16.886488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1331/2649] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:16 2022] POST /identity/v3/projects => generated 403 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:16.895523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:16.919610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7541d8-7997-4168-86d3-936a2cbf420d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:16.994527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:17.023168 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.024506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.024897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.025265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.026005 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.028119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.063218 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1319/2650] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:16 2022] POST /identity/v3/users => generated 302 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:17.064413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.075343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ad409-7585-4458-8ca5-49a5222fae64 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.080314 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.080922 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.081240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.081502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.082147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.083763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.098278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1332/2651] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:17.100758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.112125 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9500975c-47de-4c80-8eb6-ecabdb2e3c3d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.117252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceacee0-9e96-440a-8676-937d243a2fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.117883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceacee0-9e96-440a-8676-937d243a2fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.118281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceacee0-9e96-440a-8676-937d243a2fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.118741 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceacee0-9e96-440a-8676-937d243a2fd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.119394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceacee0-9e96-440a-8676-937d243a2fd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.121052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceacee0-9e96-440a-8676-937d243a2fd8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.261121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1320/2652] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:17.265573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.277480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05defdda-27ec-4442-b346-c590b7635f40 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.284777 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.285451 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.285713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.285987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] PATH_INFO: `/v3/projects/c1f8e17d9b5346d8a207c3f674d39b80/users/f8e7d2de1cdf4dc485aae996b5e7c1a0/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.302798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f8e17d9b5346d8a207c3f674d39b80, user_id=f8e7d2de1cdf4dc485aae996b5e7c1a0, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.305628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.330158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1333/2653] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:17 2022] PUT /identity/v3/projects/c1f8e17d9b5346d8a207c3f674d39b80/users/f8e7d2de1cdf4dc485aae996b5e7c1a0/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:17.337942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.338234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.338568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.371936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] MFA Rules not processed for user `f8e7d2de1cdf4dc485aae996b5e7c1a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:17.373561 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:17.459665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1321/2654] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:17.465953 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.529608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab274c-52ba-4b18-a7a0-29790b371c21 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.534469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.535073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.535351 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.535617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.536286 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.538254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.572735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1334/2655] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:17 2022] POST /identity/v3/projects => generated 405 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:17.578251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.590569 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93697d0-e77b-4478-b2b2-3f2680b887d6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.662625 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.663333 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.663608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.663905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.664618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.666612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.689131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1322/2656] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:17 2022] POST /identity/v3/users => generated 309 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:17.693493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.704637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262dcc89-0aaf-4384-9768-adeebd3e5119 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.709627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.710375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.710670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.710863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.711568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.713265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.720540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:17.726445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1335/2657] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:17.730343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.741076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f393b7-bc03-495e-92a8-94ccdae8dc36 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.746759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.747454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.747728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.748172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] PATH_INFO: `/v3/projects/d39bbdcfb8264ea6812a6b59cc51f755/users/c10328680aaf4840895db2528817a22f/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.764987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39bbdcfb8264ea6812a6b59cc51f755, user_id=c10328680aaf4840895db2528817a22f, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.767902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.785055 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1323/2658] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:17 2022] PUT /identity/v3/projects/d39bbdcfb8264ea6812a6b59cc51f755/users/c10328680aaf4840895db2528817a22f/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:17.790278 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.809919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af2351-8e8d-4aec-a1e2-47c7bfbbc821 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.873478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.875216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:17.893403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.893924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.894198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.894461 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.895170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.896868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.904861 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:17.909444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1336/2659] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:17.913884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:17.928313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b947c-6e66-4bf7-814a-2863b5952bb8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.935184 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e58382-b6ad-4a26-a680-fd4f9dca7466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.936115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e58382-b6ad-4a26-a680-fd4f9dca7466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.936524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e58382-b6ad-4a26-a680-fd4f9dca7466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.936951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e58382-b6ad-4a26-a680-fd4f9dca7466 admin admin] PATH_INFO: `/v3/projects/d39bbdcfb8264ea6812a6b59cc51f755/users/c10328680aaf4840895db2528817a22f/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.939748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e58382-b6ad-4a26-a680-fd4f9dca7466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39bbdcfb8264ea6812a6b59cc51f755, user_id=c10328680aaf4840895db2528817a22f, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.942460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e58382-b6ad-4a26-a680-fd4f9dca7466 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.946183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c64e5-074c-49e1-a3ae-1d15e65acbfd admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:17.950963 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:17.955140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.955140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.955140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.955662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1337/2660] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:17 2022] PUT /identity/v3/projects/d39bbdcfb8264ea6812a6b59cc51f755/users/c10328680aaf4840895db2528817a22f/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:17.957101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:17.966099 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:17.966831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:17.967282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:17.975174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:17.976634 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:17.987225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1324/2661] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:18.004975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] MFA Rules not processed for user `c10328680aaf4840895db2528817a22f`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:18.006206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:18.079971 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1338/2662] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:17 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:18.093604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:18.095210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:18.161299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e751510d-ac11-42e7-8534-44a381610890 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:18.219916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db195cd2-318c-424a-887a-e0c25b35430b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:18.220905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db195cd2-318c-424a-887a-e0c25b35430b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:18.221153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db195cd2-318c-424a-887a-e0c25b35430b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:18.221675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db195cd2-318c-424a-887a-e0c25b35430b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:18.233570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db195cd2-318c-424a-887a-e0c25b35430b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:18.234785 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db195cd2-318c-424a-887a-e0c25b35430b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:18.247478 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1325/2663] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:18.437621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:18.516031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fce11c-f637-42e5-b3a8-985d8293ab68 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:18.520701 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:18.521336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:18.521605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:18.521872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] PATH_INFO: `/v3/users/f8e7d2de1cdf4dc485aae996b5e7c1a0` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:18.523015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8e7d2de1cdf4dc485aae996b5e7c1a0)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:18.525242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:18.536440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:18.587803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8e7d2de1cdf4dc485aae996b5e7c1a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:18.599029 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8e7d2de1cdf4dc485aae996b5e7c1a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:18.599803 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8e7d2de1cdf4dc485aae996b5e7c1a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:18.600525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8e7d2de1cdf4dc485aae996b5e7c1a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:18.613669 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8e7d2de1cdf4dc485aae996b5e7c1a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:18.628366 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1339/2664] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:18 2022] DELETE /identity/v3/users/f8e7d2de1cdf4dc485aae996b5e7c1a0 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:18.633638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:18.633917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:18.634181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:18.656283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:18.657496 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:18.719921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1326/2665] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:18.730073 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:18.731479 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:18.790023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5e45ed-4986-45f5-8fd0-f0705bc8caea admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:18.793549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:18.794145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:18.794419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:18.794813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:18.804589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:18.807130 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:18.817251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1340/2666] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:19.136867 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:19.138999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:19.154401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d74af-3eab-446c-a4ba-e9b202538f45 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:19.161628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:19.162549 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:19.163013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:19.163446 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] PATH_INFO: `/v3/projects/c1f8e17d9b5346d8a207c3f674d39b80` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:19.165448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f8e17d9b5346d8a207c3f674d39b80)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:19.167798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:19.198040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:19.223003 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f8e17d9b5346d8a207c3f674d39b80', 'request_id': 'req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.229609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f8e17d9b5346d8a207c3f674d39b80', 'request_id': 'req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.235986 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f8e17d9b5346d8a207c3f674d39b80', 'request_id': 'req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.249897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] The token cache is being invalidate because project c1f8e17d9b5346d8a207c3f674d39b80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:19.250292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.251233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.253247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1327/2667] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:19 2022] DELETE /identity/v3/projects/c1f8e17d9b5346d8a207c3f674d39b80 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:19.260088 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:19.269814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dfcd03-8469-4bac-a8de-f72f35f1da61 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:19.335404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:19.336568 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:19.336850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:19.337121 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] PATH_INFO: `/v3/users/c10328680aaf4840895db2528817a22f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:19.338290 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10328680aaf4840895db2528817a22f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:19.340332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:19.384376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:19.401997 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10328680aaf4840895db2528817a22f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.411203 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10328680aaf4840895db2528817a22f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.411926 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10328680aaf4840895db2528817a22f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.414817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10328680aaf4840895db2528817a22f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.433509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-5810296a-1b99-41ac-8641-ade9d3d8f096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10328680aaf4840895db2528817a22f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.452826 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1341/2668] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:19 2022] DELETE /identity/v3/users/c10328680aaf4840895db2528817a22f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:19.793022 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:19.794849 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:19.809653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974d4a6-c927-4e7f-b12c-e90a5f588ce1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:19.892086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:19.892879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:19.893229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:19.893565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] PATH_INFO: `/v3/projects/d39bbdcfb8264ea6812a6b59cc51f755` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:19.894818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39bbdcfb8264ea6812a6b59cc51f755)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:19.897061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:19.962997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39bbdcfb8264ea6812a6b59cc51f755', 'request_id': 'req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.976994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39bbdcfb8264ea6812a6b59cc51f755', 'request_id': 'req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:19.985630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39bbdcfb8264ea6812a6b59cc51f755', 'request_id': 'req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.005698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] The token cache is being invalidate because project d39bbdcfb8264ea6812a6b59cc51f755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:20.005999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.006696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8c7e7ae9-6538-4cc3-9523-cce45fe262d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.009118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1328/2669] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:19 2022] DELETE /identity/v3/projects/d39bbdcfb8264ea6812a6b59cc51f755 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:20.014242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.014751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.015256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.050759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:20.052234 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.133597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1342/2670] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:20.141621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.142820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.142820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.165025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:20.166738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.176220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1329/2671] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:20.181124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.204440 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72eaa7-15b9-418b-8759-9390d8b17df0 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.210283 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.211305 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.211649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.212009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.213003 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:20.213199 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.215807 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.240158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1343/2672] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:20.244991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.259905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d0afd-a78f-41a7-ac09-c39058fac16a None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.268291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.268916 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.269195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.269479 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.270297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.272260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.305882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1330/2673] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:20.310820 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.322756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d85993-41b0-45ff-ae37-6274d8fe9ed6 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.400861 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.401593 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.401867 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.402139 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.402792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.404767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.426413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1344/2674] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/users => generated 287 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:20.431529 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.442976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3876a30a-de44-42a6-b5f5-098b880b8ddb admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.448763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.449842 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.450213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.450554 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.451319 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.453021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.461924 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:20.470743 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1331/2675] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:20.473417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.482878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50965ad7-b56a-4d59-8ce5-e8ca47e1ab79 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.487998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.488475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.488757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.489026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.489696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.491646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.504236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1345/2676] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:20.509063 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.523050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2a881-b4e8-4dd8-b43c-5ae2ddfe6f54 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.528122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c039baf-1ff6-40e3-9a50-2e75340a5c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.532020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c039baf-1ff6-40e3-9a50-2e75340a5c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.532427 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c039baf-1ff6-40e3-9a50-2e75340a5c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.532777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c039baf-1ff6-40e3-9a50-2e75340a5c72 admin admin] PATH_INFO: `/v3/projects/3a391ae0d34444c6b785fd6760a3a006/users/e16641abc3aa4089aa69ca757970dd57/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.533195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.536332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.550552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c039baf-1ff6-40e3-9a50-2e75340a5c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a391ae0d34444c6b785fd6760a3a006, user_id=e16641abc3aa4089aa69ca757970dd57, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.551148 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4245ec-e9fe-46b7-b035-218950face14 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.553617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c039baf-1ff6-40e3-9a50-2e75340a5c72 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.557245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.557976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.558262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.558601 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] PATH_INFO: `/v3/users/7f2962587173494a81490947255986ec` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.559806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2962587173494a81490947255986ec)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.562226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.569565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1332/2677] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:20 2022] PUT /identity/v3/projects/3a391ae0d34444c6b785fd6760a3a006/users/e16641abc3aa4089aa69ca757970dd57/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:20.577049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:20.580727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.580998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.581301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.612888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] MFA Rules not processed for user `e16641abc3aa4089aa69ca757970dd57`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:20.614121 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.629196 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2962587173494a81490947255986ec'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.639668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2962587173494a81490947255986ec'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.640277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2962587173494a81490947255986ec'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.641054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2962587173494a81490947255986ec'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.654897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6d4aff07-4c2f-4780-961a-43e9817723fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2962587173494a81490947255986ec'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:20.672329 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1346/2678] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:20 2022] DELETE /identity/v3/users/7f2962587173494a81490947255986ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:20.673731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.674015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.674292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.698823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:20.700454 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.705241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1333/2679] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:20.709768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.711917 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.808917 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1347/2680] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:20.817157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.821075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:20.838366 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401fcda-c16c-452b-b180-ffbe296a4d66 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.859002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.860108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.860735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.861187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.862153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.864289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:20.901742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1334/2681] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/projects => generated 373 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:20.905359 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:20.910299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b51da4-b17d-4b3c-bdb8-a737efb4102c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.970215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:20.976449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:20.983994 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.986651 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.987044 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.987415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.988981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd0e92-da60-4e32-95f9-0ef155ab9603 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:20.993827 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:20.994444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:20.994724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:20.994999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:20.995658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:20.997755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.000633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.002134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.013300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1348/2682] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:21.023930 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1335/2683] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:20 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:21.028242 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.038183 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f70e33-e2fb-48df-b8a3-925f6ca4ab39 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.044937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.046333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.046993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.047503 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.048443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.050063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.062654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1349/2684] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:21.068555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.082851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f24f4-4990-4de8-91dd-187f560d311a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.090087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.091697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.092474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.093171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] PATH_INFO: `/v3/projects/8f87c1cef2f5458c9ece37342465533e/users/72b7e6c8fda54f2c9fd6509600416f5c/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.114355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f87c1cef2f5458c9ece37342465533e, user_id=72b7e6c8fda54f2c9fd6509600416f5c, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.116765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.136094 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1336/2685] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:21 2022] PUT /identity/v3/projects/8f87c1cef2f5458c9ece37342465533e/users/72b7e6c8fda54f2c9fd6509600416f5c/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:21.140524 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.154438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3345cddc-0405-4384-a71d-27fcaf3c0426 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.235898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7e19a0-1172-4112-b7d6-eaff0a0f8fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.236711 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e19a0-1172-4112-b7d6-eaff0a0f8fec admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.237058 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e19a0-1172-4112-b7d6-eaff0a0f8fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.237395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e19a0-1172-4112-b7d6-eaff0a0f8fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.238226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e19a0-1172-4112-b7d6-eaff0a0f8fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.239909 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7e19a0-1172-4112-b7d6-eaff0a0f8fec admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.255602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1350/2686] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:21 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:21.256895 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.267594 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2899118-12db-4354-be37-e2850ffb4a48 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.272683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.273628 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.273939 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.274281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] PATH_INFO: `/v3/projects/8f87c1cef2f5458c9ece37342465533e/users/72b7e6c8fda54f2c9fd6509600416f5c/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.276390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f87c1cef2f5458c9ece37342465533e, user_id=72b7e6c8fda54f2c9fd6509600416f5c, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.279089 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.303999 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1337/2687] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:21 2022] PUT /identity/v3/projects/8f87c1cef2f5458c9ece37342465533e/users/72b7e6c8fda54f2c9fd6509600416f5c/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:21.309514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.310037 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.310815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.344422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] MFA Rules not processed for user `72b7e6c8fda54f2c9fd6509600416f5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:21.344804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:21.443093 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1351/2688] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:21.454874 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.456707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:21.552721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c53a4d-88b2-4151-9360-e269cb6ff5bc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.570217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.571671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.572029 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.572501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.577614 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.578335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:21.592112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.595778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.623376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1338/2689] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:21.678467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=100 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:21.689882 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f0573-5597-42d4-9d2c-90127167fb48 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.701250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.701870 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.702163 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.702410 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] PATH_INFO: `/v3/projects/d12171c58e7f4870b522cb32e77e4d7c` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.703556 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12171c58e7f4870b522cb32e77e4d7c)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.705538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.767796 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12171c58e7f4870b522cb32e77e4d7c', 'request_id': 'req-859b5b00-5db4-45c0-94e6-3c88634ab9d7'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.776040 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12171c58e7f4870b522cb32e77e4d7c', 'request_id': 'req-859b5b00-5db4-45c0-94e6-3c88634ab9d7'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.785246 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12171c58e7f4870b522cb32e77e4d7c', 'request_id': 'req-859b5b00-5db4-45c0-94e6-3c88634ab9d7'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.799178 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] The token cache is being invalidate because project d12171c58e7f4870b522cb32e77e4d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:21.799473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.800309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.804020 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1352/2690] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:21 2022] DELETE /identity/v3/projects/d12171c58e7f4870b522cb32e77e4d7c => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:21.807371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:21.821382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e291653c-6b1e-4558-bdca-e376cd3418eb service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:21.906696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:21.908493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:21.908769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:21.908968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] PATH_INFO: `/v3/users/1e623f7669044523950a72938c3d2faf` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:21.910556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e623f7669044523950a72938c3d2faf)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:21.913278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:21.980653 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e623f7669044523950a72938c3d2faf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.982050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:21.989435 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e623f7669044523950a72938c3d2faf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:21.990090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e623f7669044523950a72938c3d2faf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.006289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e623f7669044523950a72938c3d2faf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.007017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8dec8eec-91a1-4786-a2b7-e483fc91688a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e623f7669044523950a72938c3d2faf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.030837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1339/2691] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:21 2022] DELETE /identity/v3/users/1e623f7669044523950a72938c3d2faf => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:22.153713 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:22.155554 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:22.171316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b5b00-5db4-45c0-94e6-3c88634ab9d7 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:22.251417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:22.251573 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.251759 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.252304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] PATH_INFO: `/v3/users/e16641abc3aa4089aa69ca757970dd57` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.253517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16641abc3aa4089aa69ca757970dd57)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:22.255626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:22.307355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16641abc3aa4089aa69ca757970dd57'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.316757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16641abc3aa4089aa69ca757970dd57'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.317245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16641abc3aa4089aa69ca757970dd57'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.317920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16641abc3aa4089aa69ca757970dd57'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.331808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16641abc3aa4089aa69ca757970dd57'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.345798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1353/2692] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:22 2022] DELETE /identity/v3/users/e16641abc3aa4089aa69ca757970dd57 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:22.350336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.350850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.350850 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.370681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:22.372280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:22.437505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1340/2693] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:22.478617 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:22.480382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:22.490227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:22.509156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:22.510593 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:22.524209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1e411-bd7a-4d9c-9b0e-75aa7f2fedd9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:22.530409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:22.531195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.531195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.531460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] PATH_INFO: `/v3/projects/16bb64c2454e4e7c9ebc5c393fb99436` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.532675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16bb64c2454e4e7c9ebc5c393fb99436)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:22.534604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:22.559002 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e8986-9f7c-4e79-b7fc-3a4a95344434 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:22.564027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3c3cc-dd8e-4ae2-a281-b9edf01fea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:22.564655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c3cc-dd8e-4ae2-a281-b9edf01fea09 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.564958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c3cc-dd8e-4ae2-a281-b9edf01fea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.565845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3c3cc-dd8e-4ae2-a281-b9edf01fea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.579843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c3cc-dd8e-4ae2-a281-b9edf01fea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:22.581254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3c3cc-dd8e-4ae2-a281-b9edf01fea09 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:22.596975 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16bb64c2454e4e7c9ebc5c393fb99436', 'request_id': 'req-aba84073-9d7f-44d5-be3c-37f04e77b4f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.605055 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1354/2694] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:22.606132 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16bb64c2454e4e7c9ebc5c393fb99436', 'request_id': 'req-aba84073-9d7f-44d5-be3c-37f04e77b4f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.612911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16bb64c2454e4e7c9ebc5c393fb99436', 'request_id': 'req-aba84073-9d7f-44d5-be3c-37f04e77b4f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.628376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] The token cache is being invalidate because project 16bb64c2454e4e7c9ebc5c393fb99436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:22.628672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.629324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aba84073-9d7f-44d5-be3c-37f04e77b4f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:22.630912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1341/2695] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:22 2022] DELETE /identity/v3/projects/16bb64c2454e4e7c9ebc5c393fb99436 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:22.637034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.637341 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.637610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.661721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:22.662923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:22.745987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1355/2696] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:22.757987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.758450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.759067 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.783654 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:22.785187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:22.802565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1342/2697] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:22.803850 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:22.816159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d57a4b-c22a-43fa-8cfe-db2d58c5317b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:22.822875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:22.823272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.823541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.824154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.824914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:22.825221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:22.827353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:22.849078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1356/2698] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:22.855476 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:22.868889 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c2015-4fb1-4e37-9543-f9af76494d35 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:22.875783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:22.877158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:22.877158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:22.878078 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:22.878933 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:22.881642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:22.927393 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1343/2699] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:22 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:22.933215 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:22.944828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0e1c-7fef-4a06-8de9-7ed21c35dc13 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.038868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.040407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.041010 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.041457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.042251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.045051 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.074643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1357/2700] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:22 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:23.079279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.092608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23fe2a-e270-454b-ad7a-be6b85dd4cc5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.103571 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.104311 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.104621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.104987 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.106336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.108364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.125686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1344/2701] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:23.129687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.136040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.139032 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.145589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22f654-a390-48f4-8e3e-820626aff8d0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.152563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.155391 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.156320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.156320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.156597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.162057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.165137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a5960-eb58-4b10-8226-4d6cf0cfac6e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.175597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1358/2702] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:23.181124 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.181336 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.182507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.182793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.183144 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] PATH_INFO: `/v3/projects/3a391ae0d34444c6b785fd6760a3a006` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.184686 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a391ae0d34444c6b785fd6760a3a006)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.187541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.190469 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:INSERT=3,keystone:DELETE=10,keystone:SELECT=87 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:23.195087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcd96e1-2487-414e-9cae-a334dc772bc3 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.206667 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92c040d-7fec-4b41-ad87-68e0388c4ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.207780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c040d-7fec-4b41-ad87-68e0388c4ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.207938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c040d-7fec-4b41-ad87-68e0388c4ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.208262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c040d-7fec-4b41-ad87-68e0388c4ef0 admin admin] PATH_INFO: `/v3/projects/9fade76450ab4d9db67669c7b9b9d206/users/eadf2472d13841f69dcabe63da512911/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.226138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:23.232851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c040d-7fec-4b41-ad87-68e0388c4ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fade76450ab4d9db67669c7b9b9d206, user_id=eadf2472d13841f69dcabe63da512911, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.235902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92c040d-7fec-4b41-ad87-68e0388c4ef0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.253605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1359/2703] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:23 2022] PUT /identity/v3/projects/9fade76450ab4d9db67669c7b9b9d206/users/eadf2472d13841f69dcabe63da512911/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:23.254201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a391ae0d34444c6b785fd6760a3a006', 'request_id': 'req-8678686a-6f60-4941-bbbd-22d0160d9dda'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.264878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a391ae0d34444c6b785fd6760a3a006', 'request_id': 'req-8678686a-6f60-4941-bbbd-22d0160d9dda'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.265476 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.265744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.266016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.273829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a391ae0d34444c6b785fd6760a3a006', 'request_id': 'req-8678686a-6f60-4941-bbbd-22d0160d9dda'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.298227 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] The token cache is being invalidate because project 3a391ae0d34444c6b785fd6760a3a006 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:23.298809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.300068 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.304618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1345/2704] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:23 2022] DELETE /identity/v3/projects/3a391ae0d34444c6b785fd6760a3a006 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:23.310966 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] MFA Rules not processed for user `eadf2472d13841f69dcabe63da512911`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:23.312622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.313372 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.315706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.394906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678686a-6f60-4941-bbbd-22d0160d9dda admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.401169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1360/2705] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:23.415123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.417792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.474494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.475490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.475989 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.476985 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] PATH_INFO: `/v3/users/72b7e6c8fda54f2c9fd6509600416f5c` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.479197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b7e6c8fda54f2c9fd6509600416f5c)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.482080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.513090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f628d-d138-4e4a-8898-6d8faf61ff3d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.522011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.523063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.523538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.524034 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.540550 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.543452 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.558574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1361/2706] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:23.564072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:23.574839 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b7e6c8fda54f2c9fd6509600416f5c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.581304 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.582916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.588708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b7e6c8fda54f2c9fd6509600416f5c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.590082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b7e6c8fda54f2c9fd6509600416f5c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.600915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d2015b-f33f-4740-a434-45548e303130 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.610276 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:23.612136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.612136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.612136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] PATH_INFO: `/v3/users/eadf2472d13841f69dcabe63da512911` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.614549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eadf2472d13841f69dcabe63da512911)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:23.615595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:23.621028 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b7e6c8fda54f2c9fd6509600416f5c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.622074 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2881609c-9feb-4180-9f2e-b9aeb726c7da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b7e6c8fda54f2c9fd6509600416f5c'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.646459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1346/2707] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:23 2022] DELETE /identity/v3/users/72b7e6c8fda54f2c9fd6509600416f5c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:23.700478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eadf2472d13841f69dcabe63da512911'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.718111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eadf2472d13841f69dcabe63da512911'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.719695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eadf2472d13841f69dcabe63da512911'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.721227 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eadf2472d13841f69dcabe63da512911'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.743905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eadf2472d13841f69dcabe63da512911'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:23.752700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:23.767562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1362/2708] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:23 2022] DELETE /identity/v3/users/eadf2472d13841f69dcabe63da512911 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:23.772635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:23.772951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:23.773230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:23.814431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:23.816809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.906602 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1347/2709] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:23.917084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:23.918738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:23.993477 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b72cff5-9981-4e23-bdc6-d617cf7554f4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:23.999521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c876ba-6ca2-40d7-89b8-a49bcc9b6a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.000243 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c876ba-6ca2-40d7-89b8-a49bcc9b6a2d service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.000626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c876ba-6ca2-40d7-89b8-a49bcc9b6a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.000901 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c876ba-6ca2-40d7-89b8-a49bcc9b6a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.012483 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c876ba-6ca2-40d7-89b8-a49bcc9b6a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.014016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c876ba-6ca2-40d7-89b8-a49bcc9b6a2d service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.024755 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1363/2710] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:24.143325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.144851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.163807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a96c03-2f97-4c3c-911f-40e409e24932 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.196293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.197076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.197364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.197661 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] PATH_INFO: `/v3/projects/8f87c1cef2f5458c9ece37342465533e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.208087 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f87c1cef2f5458c9ece37342465533e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.210562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.294090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f87c1cef2f5458c9ece37342465533e', 'request_id': 'req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.300962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f87c1cef2f5458c9ece37342465533e', 'request_id': 'req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.308528 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f87c1cef2f5458c9ece37342465533e', 'request_id': 'req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.328398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] The token cache is being invalidate because project 8f87c1cef2f5458c9ece37342465533e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:24.328714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.329418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.331214 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1348/2711] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:24 2022] DELETE /identity/v3/projects/8f87c1cef2f5458c9ece37342465533e => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:24.336262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198262-1cbc-4491-83c3-94f2ff76ce30 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.336799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198262-1cbc-4491-83c3-94f2ff76ce30 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.336799 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198262-1cbc-4491-83c3-94f2ff76ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.358621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-44198262-1cbc-4491-83c3-94f2ff76ce30 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:24.360107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-44198262-1cbc-4491-83c3-94f2ff76ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.363392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.366542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.437444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:24.438560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1364/2712] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:24.446622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.447066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.447349 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.467592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef4d3f7-3c47-42fc-8382-4dcf8784fb23 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.470636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:24.471923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.477426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.478225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.478796 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.479434 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] PATH_INFO: `/v3/projects/9fade76450ab4d9db67669c7b9b9d206` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.485265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1365/2713] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:24.485411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fade76450ab4d9db67669c7b9b9d206)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.486480 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.486610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.497564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde2e49-ba76-4537-8435-2e95dd0d52bb None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.502748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.503575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.503918 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.505408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.506179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:24.506498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.508372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.527497 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1366/2714] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:24.529590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.541903 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515a5b9d-bba3-4c8d-96eb-43aa6934473f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.553233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.555569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.556888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.557462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.559399 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.565491 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.571431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fade76450ab4d9db67669c7b9b9d206', 'request_id': 'req-2c758b8a-92eb-4378-9c2f-41f1ace96a13'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.578048 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fade76450ab4d9db67669c7b9b9d206', 'request_id': 'req-2c758b8a-92eb-4378-9c2f-41f1ace96a13'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.586806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fade76450ab4d9db67669c7b9b9d206', 'request_id': 'req-2c758b8a-92eb-4378-9c2f-41f1ace96a13'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.608551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] The token cache is being invalidate because project 9fade76450ab4d9db67669c7b9b9d206 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:24.609199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.609925 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2c758b8a-92eb-4378-9c2f-41f1ace96a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:24.611691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1349/2715] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:24 2022] DELETE /identity/v3/projects/9fade76450ab4d9db67669c7b9b9d206 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:24.616507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86efe-f687-4978-bf08-cf3a89d3fdb6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.616765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86efe-f687-4978-bf08-cf3a89d3fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.617053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86efe-f687-4978-bf08-cf3a89d3fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.629413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1367/2716] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/projects => generated 357 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:24.633894 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.636300 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.650544 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-89e86efe-f687-4978-bf08-cf3a89d3fdb6 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:24.653194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-89e86efe-f687-4978-bf08-cf3a89d3fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.730019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:24.735520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b93f48-5f09-4ca6-9293-dab31dd60a35 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.745947 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.746871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.747137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.747409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.748171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.750216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.759154 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1350/2717] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:24.768252 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.768982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.769424 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.788753 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1368/2718] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/users => generated 279 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:24.790065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.792407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:24.793697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.801465 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425bf6a4-d978-4e73-a056-aa8ea4e63737 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.806463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1351/2719] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:24.807500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.809458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.810082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.810363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.810632 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.811274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.812962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.817619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45effdb7-e8cc-458c-8701-4dacd9bbe376 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.823194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.823806 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.824371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.824636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.827992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1369/2720] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:24.828152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:24.828152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.828152 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.829638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.841980 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf159c-6214-4920-9f5a-79e7411a6da8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.844257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1352/2721] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:26:24.847343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.855267 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.855897 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.856216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.856487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.857145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.858734 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af48979-8325-4c0a-b7f6-89c293fa0834 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.858880 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.863315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.863923 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.864234 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.864504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.865140 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.867156 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.872061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1370/2722] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:24.874393 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.885704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d0efd-358a-42aa-9edb-d66cb595234a admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:24.890715 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa39d6e-3f57-4407-a2ff-411fe9db733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:24.891913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39d6e-3f57-4407-a2ff-411fe9db733f admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.892270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39d6e-3f57-4407-a2ff-411fe9db733f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.892574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa39d6e-3f57-4407-a2ff-411fe9db733f admin admin] PATH_INFO: `/v3/projects/95e49dfe05934b2d8a54a70230719a67/users/9cb94c676add4215b789155e9083248e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.903694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1353/2723] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:24.907809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:24.913685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa39d6e-3f57-4407-a2ff-411fe9db733f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e49dfe05934b2d8a54a70230719a67, user_id=9cb94c676add4215b789155e9083248e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:24.921984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa39d6e-3f57-4407-a2ff-411fe9db733f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:24.937774 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1371/2724] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:24 2022] PUT /identity/v3/projects/95e49dfe05934b2d8a54a70230719a67/users/9cb94c676add4215b789155e9083248e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:24.947877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:24.948657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:24.949171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:24.949466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:24.982727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] MFA Rules not processed for user `9cb94c676add4215b789155e9083248e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:24.984253 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:24.998681 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ce85f-0b24-4c2e-a0ae-d1d4962f00d0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.078378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1372/2725] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:25.079246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.079877 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.080186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.080459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.081098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.083130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.083641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.103177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cbd70-ca93-474a-a8e7-027543b7727d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.108508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.109166 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.109407 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.109671 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.110307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.111537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1354/2726] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:24 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:25.112363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.115791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.127646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b9115-f6c9-4b44-a121-51ad1a550972 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.132766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.133587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.134081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.134392 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.135177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.136852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.148926 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1355/2728] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:25.149248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1373/2728] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:25 2022] POST /identity/v3/projects => generated 355 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:25.152382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.165062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.180376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4efd34-742a-457b-a35b-806784da9fe6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.278807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.279875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.280274 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.280553 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.281636 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.287314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.288730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd6993a-d9cc-419d-bcc3-a6ad4f41d558 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.299123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.300580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.301382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.302261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.303376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.307538 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.319717 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1356/2729] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:25 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:25.325030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.340960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d8809-7826-4ffe-86e9-3a08fd20b8a1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.344534 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1374/2730] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:25.347913 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.348710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.349521 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.349876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.350229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.351309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.354733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.359238 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:25.366730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfffecf-a8cf-4a7a-926d-c66ced870f9d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.370504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1357/2731] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:25.374752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.378854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.390906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.391194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.391466 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] PATH_INFO: `/v3/projects/1c17cd9fe8a34f7eaa8fab145018c514/users/4c63299d356647249b49a2e79a969b7e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.392455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44483a6-9207-4769-9207-cf70c5af4fec admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.407131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e20958-9655-4ec3-bb8f-9419346dc51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.407809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e20958-9655-4ec3-bb8f-9419346dc51e admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.408149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e20958-9655-4ec3-bb8f-9419346dc51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.408403 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e20958-9655-4ec3-bb8f-9419346dc51e admin admin] PATH_INFO: `/v3/projects/2637a381c9b14eea892b1e9a5b46d13b/users/45002ba420024c8ca908eca8528baa01/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.428194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c17cd9fe8a34f7eaa8fab145018c514, user_id=4c63299d356647249b49a2e79a969b7e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.430984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.431129 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e20958-9655-4ec3-bb8f-9419346dc51e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2637a381c9b14eea892b1e9a5b46d13b, user_id=45002ba420024c8ca908eca8528baa01, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.433738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e20958-9655-4ec3-bb8f-9419346dc51e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.453708 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1375/2732] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:25 2022] PUT /identity/v3/projects/1c17cd9fe8a34f7eaa8fab145018c514/users/4c63299d356647249b49a2e79a969b7e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:25.454105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1358/2733] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:25 2022] PUT /identity/v3/projects/2637a381c9b14eea892b1e9a5b46d13b/users/45002ba420024c8ca908eca8528baa01/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:25.458591 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.464897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.465297 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.466006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.501213 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:25.514092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] MFA Rules not processed for user `4c63299d356647249b49a2e79a969b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:25.515881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:25.560386 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c43db-5141-422c-a0f8-fff87a6fc3fd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.630731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1359/2734] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:25.644463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.645870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:25.665301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.666955 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.667885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.668361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.669569 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.671625 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.686560 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1376/2735] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:26:25.690417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.708015 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6737e7aa-b158-460b-b430-b5f1b4ab9ea0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.719194 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091101b0-a731-4bbf-8740-32c6a291233b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.719976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091101b0-a731-4bbf-8740-32c6a291233b admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.720590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091101b0-a731-4bbf-8740-32c6a291233b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.720869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091101b0-a731-4bbf-8740-32c6a291233b admin admin] PATH_INFO: `/v3/projects/2637a381c9b14eea892b1e9a5b46d13b/users/45002ba420024c8ca908eca8528baa01/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.721832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c565349-bd0a-429c-8d63-39a858d9b458 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.724863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091101b0-a731-4bbf-8740-32c6a291233b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2637a381c9b14eea892b1e9a5b46d13b, user_id=45002ba420024c8ca908eca8528baa01, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.728221 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091101b0-a731-4bbf-8740-32c6a291233b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.731126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.731771 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.732783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.733058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.742570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1377/2736] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:25 2022] PUT /identity/v3/projects/2637a381c9b14eea892b1e9a5b46d13b/users/45002ba420024c8ca908eca8528baa01/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:25.743294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.745149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.754493 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.755084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.755562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.756666 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1360/2737] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:25.792645 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] MFA Rules not processed for user `45002ba420024c8ca908eca8528baa01`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:25.794252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:25.872899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:25.886106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1378/2738] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:25.899735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.901417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:25.906415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:25.907761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:25.915768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dbefff-edd3-49f4-8239-9eea8fb3f99f service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.981285 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.981854 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.982137 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.982517 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.985587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3db4e-0087-4fc4-92cf-bd867ac72521 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:25.990362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:25.991025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:25.991306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:25.991585 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] PATH_INFO: `/v3/users/722f2173a5cc46e4ad7fa92aafdcdc6e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:25.993222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.993352 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=722f2173a5cc46e4ad7fa92aafdcdc6e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:25.994740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:25.995230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:26.005871 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1361/2739] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:26.058814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '722f2173a5cc46e4ad7fa92aafdcdc6e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.074813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '722f2173a5cc46e4ad7fa92aafdcdc6e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.075937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '722f2173a5cc46e4ad7fa92aafdcdc6e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.076786 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '722f2173a5cc46e4ad7fa92aafdcdc6e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.109389 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '722f2173a5cc46e4ad7fa92aafdcdc6e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.129957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1379/2740] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:25 2022] DELETE /identity/v3/users/722f2173a5cc46e4ad7fa92aafdcdc6e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:26.131290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:26.146463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e868-3d08-4deb-8c45-a4703235cf79 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:26.232174 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:26.239108 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:26.240050 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:26.240344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:26.240778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:26.243171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:26.308676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:26.310433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:26.321351 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1362/2741] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:26.331904 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:26.334009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:26.411417 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7570a75-58bb-4b2b-ba59-0423420f2a1d admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:26.417517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:26.418150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:26.418429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:26.418716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] PATH_INFO: `/v3/projects/94a3063020764db192a3e6b25082fd66` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:26.419834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94a3063020764db192a3e6b25082fd66)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:26.421804 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:26.440678 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:26.475116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94a3063020764db192a3e6b25082fd66', 'request_id': 'req-c798b1e1-1bcd-4268-970b-7b2f431e97a9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.482049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94a3063020764db192a3e6b25082fd66', 'request_id': 'req-c798b1e1-1bcd-4268-970b-7b2f431e97a9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.489722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94a3063020764db192a3e6b25082fd66', 'request_id': 'req-c798b1e1-1bcd-4268-970b-7b2f431e97a9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.500872 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] The token cache is being invalidate because project 94a3063020764db192a3e6b25082fd66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:26.501152 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.501778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.503261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1380/2742] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:26 2022] DELETE /identity/v3/projects/94a3063020764db192a3e6b25082fd66 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:26.507204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:26.518633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98a06e-f65e-495e-8744-9d4e37ecd87a service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:26.575314 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:26.575935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:26.576238 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:26.576505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] PATH_INFO: `/v3/users/387f29ce456646cebf90f1b4ca8ee163` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:26.577630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=387f29ce456646cebf90f1b4ca8ee163)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:26.579521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:26.625173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '387f29ce456646cebf90f1b4ca8ee163'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.632075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '387f29ce456646cebf90f1b4ca8ee163'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.632692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '387f29ce456646cebf90f1b4ca8ee163'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.644277 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '387f29ce456646cebf90f1b4ca8ee163'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.644904 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '387f29ce456646cebf90f1b4ca8ee163'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.657323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1363/2743] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:26 2022] DELETE /identity/v3/users/387f29ce456646cebf90f1b4ca8ee163 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:26.828110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:26.829620 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:26.842974 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798b1e1-1bcd-4268-970b-7b2f431e97a9 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:26.899552 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:26.900207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:26.900487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:26.900757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] PATH_INFO: `/v3/projects/76e2271a65be4b99aa66e2a1ee38f964` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:26.901869 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e2271a65be4b99aa66e2a1ee38f964)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:26.904025 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:26.949277 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e2271a65be4b99aa66e2a1ee38f964', 'request_id': 'req-bd9022f0-c02d-40d4-9c8d-0b697666592c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.955403 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e2271a65be4b99aa66e2a1ee38f964', 'request_id': 'req-bd9022f0-c02d-40d4-9c8d-0b697666592c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.963551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e2271a65be4b99aa66e2a1ee38f964', 'request_id': 'req-bd9022f0-c02d-40d4-9c8d-0b697666592c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.973875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] The token cache is being invalidate because project 76e2271a65be4b99aa66e2a1ee38f964 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:26.974159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.974773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-bd9022f0-c02d-40d4-9c8d-0b697666592c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:26.976275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1381/2744] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:26 2022] DELETE /identity/v3/projects/76e2271a65be4b99aa66e2a1ee38f964 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:31.580695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:31.582876 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:31.600106 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d8ae4c-429a-4aba-93e2-261a7298be4e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:31.621412 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:31.674405 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:31.675305 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:31.676008 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:31.676422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] PATH_INFO: `/v3/users/4c63299d356647249b49a2e79a969b7e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:31.677742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c63299d356647249b49a2e79a969b7e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:31.679713 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:31.755896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c63299d356647249b49a2e79a969b7e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:31.772065 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c63299d356647249b49a2e79a969b7e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:31.772808 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c63299d356647249b49a2e79a969b7e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:31.793679 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c63299d356647249b49a2e79a969b7e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:31.794376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c63299d356647249b49a2e79a969b7e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:31.810002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1364/2745] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:31 2022] DELETE /identity/v3/users/4c63299d356647249b49a2e79a969b7e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:31.816141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:31.816763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:31.816763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:31.846065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:31.847355 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:31.901878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:31.971458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1382/2746] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:31.988195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:31.990793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:32.089819 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8fdab9-9beb-433c-9168-6bb5ea882b62 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:32.094381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1375164-2889-4a83-a32a-86d1effb51fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:32.095075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375164-2889-4a83-a32a-86d1effb51fe service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.095327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375164-2889-4a83-a32a-86d1effb51fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.095599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1375164-2889-4a83-a32a-86d1effb51fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.106592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1375164-2889-4a83-a32a-86d1effb51fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:32.108897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1375164-2889-4a83-a32a-86d1effb51fe service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:32.125122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1365/2747] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:32.486780 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:32.488260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:32.501851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210d4f3-cacf-46d4-b460-0669a1f4913c None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:32.508430 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:32.509549 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.510096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.510500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] PATH_INFO: `/v3/projects/1c17cd9fe8a34f7eaa8fab145018c514` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.512086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c17cd9fe8a34f7eaa8fab145018c514)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:32.514285 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:32.574883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c17cd9fe8a34f7eaa8fab145018c514', 'request_id': 'req-cf75de4a-1f57-4d61-894f-8ff33d536b16'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:32.581958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c17cd9fe8a34f7eaa8fab145018c514', 'request_id': 'req-cf75de4a-1f57-4d61-894f-8ff33d536b16'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:32.590508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c17cd9fe8a34f7eaa8fab145018c514', 'request_id': 'req-cf75de4a-1f57-4d61-894f-8ff33d536b16'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:32.604555 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] The token cache is being invalidate because project 1c17cd9fe8a34f7eaa8fab145018c514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:32.604873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:32.605494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-cf75de4a-1f57-4d61-894f-8ff33d536b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:32.607011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1383/2748] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:32 2022] DELETE /identity/v3/projects/1c17cd9fe8a34f7eaa8fab145018c514 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:32.612425 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.612944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.612944 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.634350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:32.635702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:32.691941 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:32.722206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1366/2749] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:32.735326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.735687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.736070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.757968 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:32.759207 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:32.768763 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1384/2750] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:32.774196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:32.785668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f4e0f-e2df-43f5-aaa7-8ae124919cca None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:32.790759 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:32.791935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.792247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.792522 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.793219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:32.793523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:32.795171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:32.809098 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1367/2751] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:32.813837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:32.823261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f593d54-a194-421f-8ca5-7432537835ba None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:32.828654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:32.829206 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.829485 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.829756 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.830422 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:32.832395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:32.878435 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1385/2752] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:32 2022] POST /identity/v3/projects => generated 399 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:32.882444 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:32.892955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7468f10-b780-4a73-ab78-2fa72a36b515 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:32.957908 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:32.959015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:32.959667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:32.959833 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:32.960612 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:32.963149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:32.988077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1368/2753] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:32 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:32.992256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:33.003149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4043eade-e117-4bb3-b7e6-020216b217af admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:33.007890 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:33.008576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:33.008860 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:33.009135 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:33.009783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:33.011837 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:33.022657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1386/2754] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:33.027828 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:33.038635 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd5352-f849-4c6c-b76e-e6d169d7862f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:33.044273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6229d0-ff10-487f-a77d-2ecda6d18eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:33.044894 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6229d0-ff10-487f-a77d-2ecda6d18eba admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:33.045172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6229d0-ff10-487f-a77d-2ecda6d18eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:33.045449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6229d0-ff10-487f-a77d-2ecda6d18eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:33.046981 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6229d0-ff10-487f-a77d-2ecda6d18eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:33.047723 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6229d0-ff10-487f-a77d-2ecda6d18eba admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:33.059572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1369/2755] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:33.064104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:33.075388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccebb03-e091-4d11-b288-c23bbd4fa442 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:33.080685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:33.081336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:33.081655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:33.082006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] PATH_INFO: `/v3/projects/6e0273af177a40ad8985ae3c8b55aa93/users/6d754eb5c3744404a7b364b1ded3ee76/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:33.098301 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0273af177a40ad8985ae3c8b55aa93, user_id=6d754eb5c3744404a7b364b1ded3ee76, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:33.101376 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:33.120478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1387/2756] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:33 2022] PUT /identity/v3/projects/6e0273af177a40ad8985ae3c8b55aa93/users/6d754eb5c3744404a7b364b1ded3ee76/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:33.190266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:33.190621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:33.190920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:33.232883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] MFA Rules not processed for user `6d754eb5c3744404a7b364b1ded3ee76`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:33.234610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:33.306233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1370/2757] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:33 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:33.317535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:33.319299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:33.383704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:33.393384 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382949fc-2b8e-4b2c-8177-4754099cd31b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:33.398453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e35b9a5-a38f-42a6-9909-4686fd5f6445 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:33.399801 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b9a5-a38f-42a6-9909-4686fd5f6445 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:33.400198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b9a5-a38f-42a6-9909-4686fd5f6445 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:33.400611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e35b9a5-a38f-42a6-9909-4686fd5f6445 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:33.417871 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b9a5-a38f-42a6-9909-4686fd5f6445 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:33.420137 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e35b9a5-a38f-42a6-9909-4686fd5f6445 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:33.431508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1388/2758] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:38.501946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:38.549411 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:38.573832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab1c0f-29e5-42fd-81a0-03e4268c1691 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:38.579484 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:38.580151 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:38.580426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:38.580694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] PATH_INFO: `/v3/users/6d754eb5c3744404a7b364b1ded3ee76` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:38.581814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d754eb5c3744404a7b364b1ded3ee76)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:38.583718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:38.633291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d754eb5c3744404a7b364b1ded3ee76'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:38.642693 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d754eb5c3744404a7b364b1ded3ee76'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:38.643492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d754eb5c3744404a7b364b1ded3ee76'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:38.658270 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d754eb5c3744404a7b364b1ded3ee76'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:38.659015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d754eb5c3744404a7b364b1ded3ee76'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:38.671463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1371/2759] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:38 2022] DELETE /identity/v3/users/6d754eb5c3744404a7b364b1ded3ee76 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:38.676579 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:38.677054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:38.677151 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:38.699077 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:38.701297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:38.767177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1389/2760] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:38.777652 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:38.778767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:38.847051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c9ba53-8474-4a30-9452-be31657ae356 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:38.850728 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:38.851338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:38.851618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:38.851881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:38.863711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:38.865111 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:38.877935 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1372/2761] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:39.162119 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:39.163761 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:39.182698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3af0df-719b-48b0-82c5-0d1ca4c8a410 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:39.188621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:39.189105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:39.189616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:39.189727 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] PATH_INFO: `/v3/projects/6e0273af177a40ad8985ae3c8b55aa93` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:39.190813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0273af177a40ad8985ae3c8b55aa93)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:39.192792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:39.249610 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0273af177a40ad8985ae3c8b55aa93', 'request_id': 'req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:39.258781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0273af177a40ad8985ae3c8b55aa93', 'request_id': 'req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:39.268171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0273af177a40ad8985ae3c8b55aa93', 'request_id': 'req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:39.280553 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] The token cache is being invalidate because project 6e0273af177a40ad8985ae3c8b55aa93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:39.280845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:39.281661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-2f3a8cf7-c599-4b12-9cad-9f7167e135d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:39.283707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1390/2762] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:39 2022] DELETE /identity/v3/projects/6e0273af177a40ad8985ae3c8b55aa93 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:41.750460 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:41.751873 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:41.764670 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8913b086-cd57-4264-a200-414fab65a5d4 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:41.821410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:41.822079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:41.822358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:41.822631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] PATH_INFO: `/v3/users/9cb94c676add4215b789155e9083248e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:41.824627 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb94c676add4215b789155e9083248e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:41.826540 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:41.828183 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:41.877657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb94c676add4215b789155e9083248e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:41.885400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb94c676add4215b789155e9083248e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:41.886153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb94c676add4215b789155e9083248e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:41.898134 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb94c676add4215b789155e9083248e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:41.898797 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb94c676add4215b789155e9083248e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:41.913537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1373/2763] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:41 2022] DELETE /identity/v3/users/9cb94c676add4215b789155e9083248e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:41.918653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:41.919347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:41.919696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:41.939046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:41.940299 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:42.001911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1391/2764] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:42.012310 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:42.013778 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:42.073377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0414c7da-708f-46b5-808e-5d593549d70e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:42.077371 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:42.077977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:42.078280 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:42.078527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:42.089969 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:42.091632 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:42.101603 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1374/2765] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:42.378382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:42.379885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:42.394198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cb150-fa61-47f6-8dd4-14fecdae5386 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:42.398844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:42.399471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:42.399747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:42.400043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] PATH_INFO: `/v3/projects/95e49dfe05934b2d8a54a70230719a67` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:42.401161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e49dfe05934b2d8a54a70230719a67)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:42.403788 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:42.412863 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:42.459369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e49dfe05934b2d8a54a70230719a67', 'request_id': 'req-8b845ce7-c07d-4236-9a51-9f2e494fefb5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.466749 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e49dfe05934b2d8a54a70230719a67', 'request_id': 'req-8b845ce7-c07d-4236-9a51-9f2e494fefb5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.474707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e49dfe05934b2d8a54a70230719a67', 'request_id': 'req-8b845ce7-c07d-4236-9a51-9f2e494fefb5'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.486513 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] The token cache is being invalidate because project 95e49dfe05934b2d8a54a70230719a67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:42.486852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.487642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.489262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1392/2766] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:42 2022] DELETE /identity/v3/projects/95e49dfe05934b2d8a54a70230719a67 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:42.493400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:42.503508 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcc9c7-e1b7-4bd4-afa3-32a2c0d7cecf service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:42.560019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:42.560648 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:42.560929 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:42.561239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] PATH_INFO: `/v3/users/45002ba420024c8ca908eca8528baa01` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:42.562374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45002ba420024c8ca908eca8528baa01)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:42.564358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:42.587695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:42.612367 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45002ba420024c8ca908eca8528baa01'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.620642 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45002ba420024c8ca908eca8528baa01'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.621454 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45002ba420024c8ca908eca8528baa01'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.633697 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45002ba420024c8ca908eca8528baa01'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.634943 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-cf3d9644-6907-48ae-9a7b-e0398a7c1fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45002ba420024c8ca908eca8528baa01'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:42.647120 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1375/2767] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:42 2022] DELETE /identity/v3/users/45002ba420024c8ca908eca8528baa01 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:42.924388 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:42.926318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:42.942500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b845ce7-c07d-4236-9a51-9f2e494fefb5 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.012551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.013186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.013468 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.013742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] PATH_INFO: `/v3/projects/2637a381c9b14eea892b1e9a5b46d13b` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.016016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2637a381c9b14eea892b1e9a5b46d13b)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.016816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.064906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2637a381c9b14eea892b1e9a5b46d13b', 'request_id': 'req-8d791aca-5866-44cd-a206-89cec102c905'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:43.071008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2637a381c9b14eea892b1e9a5b46d13b', 'request_id': 'req-8d791aca-5866-44cd-a206-89cec102c905'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:43.079757 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2637a381c9b14eea892b1e9a5b46d13b', 'request_id': 'req-8d791aca-5866-44cd-a206-89cec102c905'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:43.093738 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] The token cache is being invalidate because project 2637a381c9b14eea892b1e9a5b46d13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:43.094027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:43.094670 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8d791aca-5866-44cd-a206-89cec102c905 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:43.096325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1393/2768] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:42 2022] DELETE /identity/v3/projects/2637a381c9b14eea892b1e9a5b46d13b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:43.101155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.101668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.101668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.125011 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:43.126610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:43.189869 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1376/2769] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:43.197697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.197977 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.198250 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.218884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:43.220138 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:43.228603 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1394/2770] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:43.233419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.243512 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3f55d-c78d-4eca-aba7-f08bd6693b02 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.249644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.250240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.250524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.250800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.251450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:43.251758 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.253406 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.265651 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1377/2771] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:43.270282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.280128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3eb3ea-bfaf-4393-8ab4-3420f8f62bbb None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.286008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.286665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.286950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.287216 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.288069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.290460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.313574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:43.326663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1395/2772] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:43.327875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.338932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93072b-82df-4438-be4c-56b9f4683d6e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.393639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.394210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.394515 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.394807 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.395441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.397374 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.423052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1378/2773] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:43.427065 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.438089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d1eb2b-94b4-4c4f-80b4-58c6a0b8ec6e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.442929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.443529 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.443802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.444105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.444741 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.446346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.461112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1396/2774] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:43.465719 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.476177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5463f6b-3c8f-4568-a9c9-bf4a04668ee8 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.481852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc795934-f830-4758-aad6-c8a3e9adc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.482463 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795934-f830-4758-aad6-c8a3e9adc05a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.482748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795934-f830-4758-aad6-c8a3e9adc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.483023 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc795934-f830-4758-aad6-c8a3e9adc05a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.483668 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc795934-f830-4758-aad6-c8a3e9adc05a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.485321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc795934-f830-4758-aad6-c8a3e9adc05a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.496574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1379/2775] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:43.500833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.511778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ff628-a5c8-45c0-90da-51a6431418cf admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.517769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.518409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.518682 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.518950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] PATH_INFO: `/v3/projects/302f45855dac4690a23c0c2c87516753/users/7556eafd23fd42f399517a535787a814/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.544607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=302f45855dac4690a23c0c2c87516753, user_id=7556eafd23fd42f399517a535787a814, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.547383 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.561408 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1397/2776] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:43 2022] PUT /identity/v3/projects/302f45855dac4690a23c0c2c87516753/users/7556eafd23fd42f399517a535787a814/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:43.573470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.573747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.574015 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.588020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:43.605539 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] MFA Rules not processed for user `7556eafd23fd42f399517a535787a814`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:43.606761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:43.676556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1380/2777] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:43.681019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.743059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf32f4-c9e9-4966-a977-42b329945b37 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.747929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.748604 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.748875 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.749240 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.749888 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.751791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.781309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1398/2778] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/projects => generated 361 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:43.785487 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.796688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef08461-9f02-4a1a-b2f2-48a7fdda48d6 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.857765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.858376 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.858766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.858920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.859551 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.861501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.885092 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1381/2779] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:43 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:43.889104 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.899595 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fba04d-3fa2-4a37-b35c-7c2675434ccd admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.904296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.904889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.905164 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.905433 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.906062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.907656 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.918062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1399/2780] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:43.922288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.933449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce7ae-8e0c-4fef-9367-65fa1b8fa8b0 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:43.938019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:43.938662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:43.938957 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:43.939212 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] PATH_INFO: `/v3/projects/955a3969f408414d86f45d26bf350ba7/users/8372c0496a2549ca9f39d5b7e69f74f5/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:43.955027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=955a3969f408414d86f45d26bf350ba7, user_id=8372c0496a2549ca9f39d5b7e69f74f5, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:43.957735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:43.971662 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1382/2781] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:43 2022] PUT /identity/v3/projects/955a3969f408414d86f45d26bf350ba7/users/8372c0496a2549ca9f39d5b7e69f74f5/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:26:43.977179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:43.987402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7614e8bd-bc0e-4907-b6bd-f9f1b0bb2a4e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:44.044964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e7828-89c2-482d-ac2b-463d5d85023d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:44.045566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e7828-89c2-482d-ac2b-463d5d85023d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:44.045873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e7828-89c2-482d-ac2b-463d5d85023d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:44.046115 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e7828-89c2-482d-ac2b-463d5d85023d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:44.046785 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e7828-89c2-482d-ac2b-463d5d85023d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:44.048427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e7828-89c2-482d-ac2b-463d5d85023d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:44.061868 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1400/2782] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:44.066100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:44.077338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f9642-b2ae-4d56-85ae-c209231320c6 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:44.082472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:44.083099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:44.083560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:44.083720 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] PATH_INFO: `/v3/projects/955a3969f408414d86f45d26bf350ba7/users/8372c0496a2549ca9f39d5b7e69f74f5/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:44.085596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] RBAC: Authorizing `identity:create_grant(project_id=955a3969f408414d86f45d26bf350ba7, user_id=8372c0496a2549ca9f39d5b7e69f74f5, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:44.088292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:44.098927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1383/2783] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:44 2022] PUT /identity/v3/projects/955a3969f408414d86f45d26bf350ba7/users/8372c0496a2549ca9f39d5b7e69f74f5/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:44.109380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:44.109661 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:44.109940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:44.143252 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] MFA Rules not processed for user `8372c0496a2549ca9f39d5b7e69f74f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:44.144488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:44.165721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:44.216721 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1401/2784] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:26:44.227995 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:44.229804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:44.287624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:44.292394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbdc7b0-daef-47fe-9079-2d30703220db admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:44.298604 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:44.299216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:44.299503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:44.299903 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:44.309948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:44.311370 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:44.320650 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1384/2785] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:26:44.401580 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:44.411883 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453da648-2731-4132-a5ac-eb0ab1e77fa8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:44.415965 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f7dae-99ab-4641-a309-a42b70abf087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:44.416576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7dae-99ab-4641-a309-a42b70abf087 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:44.416852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7dae-99ab-4641-a309-a42b70abf087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:44.417136 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f7dae-99ab-4641-a309-a42b70abf087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:44.484036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f7dae-99ab-4641-a309-a42b70abf087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:44.485363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f7dae-99ab-4641-a309-a42b70abf087 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:44.495233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1402/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:47.288141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:47.356630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd8211-65e9-4032-864e-eb26db7e7d88 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:47.361402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:47.362026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:47.362301 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:47.362568 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] PATH_INFO: `/v3/users/7556eafd23fd42f399517a535787a814` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:47.363684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7556eafd23fd42f399517a535787a814)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:47.365674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:47.419597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7556eafd23fd42f399517a535787a814'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:47.427638 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7556eafd23fd42f399517a535787a814'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:47.428293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7556eafd23fd42f399517a535787a814'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:47.444268 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7556eafd23fd42f399517a535787a814'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:47.445006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7556eafd23fd42f399517a535787a814'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:47.457938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1385/2787] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:47 2022] DELETE /identity/v3/users/7556eafd23fd42f399517a535787a814 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:47.462769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:47.463332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:47.463470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:47.484523 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:47.485734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:47.546533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1403/2788] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:47.557882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:47.560058 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:47.622442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7384768-b8e3-40af-a2af-a3822cf5db17 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:47.626155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:47.626789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:47.627066 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:47.627335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:47.638966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:47.640519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:47.652768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1386/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:48.017823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:48.020046 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:48.033885 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce06afc-bfb6-4c0c-8785-eaece62b8f9b None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:48.039038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:48.039767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.040815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.041108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] PATH_INFO: `/v3/projects/302f45855dac4690a23c0c2c87516753` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.042474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302f45855dac4690a23c0c2c87516753)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:48.044839 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:48.103462 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302f45855dac4690a23c0c2c87516753', 'request_id': 'req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.105819 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:48.110728 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302f45855dac4690a23c0c2c87516753', 'request_id': 'req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.120419 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302f45855dac4690a23c0c2c87516753', 'request_id': 'req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.131488 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] The token cache is being invalidate because project 302f45855dac4690a23c0c2c87516753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:48.131783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.132469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.133958 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1404/2790] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:48 2022] DELETE /identity/v3/projects/302f45855dac4690a23c0c2c87516753 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:48.138043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:48.148672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a4e0ff-55ef-4c4a-adfb-14abf39e0605 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:48.158931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:48.211254 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:48.211792 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.212128 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.212395 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] PATH_INFO: `/v3/users/8372c0496a2549ca9f39d5b7e69f74f5` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.213519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8372c0496a2549ca9f39d5b7e69f74f5)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:48.215422 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:48.263624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8372c0496a2549ca9f39d5b7e69f74f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.271161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8372c0496a2549ca9f39d5b7e69f74f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.271937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8372c0496a2549ca9f39d5b7e69f74f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.285304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8372c0496a2549ca9f39d5b7e69f74f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.286316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-6b4279ff-cd38-45bc-8e02-c5c741d36a02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8372c0496a2549ca9f39d5b7e69f74f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.300683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1387/2791] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:26:48 2022] DELETE /identity/v3/users/8372c0496a2549ca9f39d5b7e69f74f5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:48.583967 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:48.585525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:48.600052 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38ce7a-1cb0-4ec6-b7c5-2d67e467eb77 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:48.667608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:48.668333 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.668566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.668836 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] PATH_INFO: `/v3/projects/955a3969f408414d86f45d26bf350ba7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.669983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=955a3969f408414d86f45d26bf350ba7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:48.671913 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:48.725109 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '955a3969f408414d86f45d26bf350ba7', 'request_id': 'req-f0594b5a-3409-4ccf-8d70-235342b696a6'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.732640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '955a3969f408414d86f45d26bf350ba7', 'request_id': 'req-f0594b5a-3409-4ccf-8d70-235342b696a6'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.740144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '955a3969f408414d86f45d26bf350ba7', 'request_id': 'req-f0594b5a-3409-4ccf-8d70-235342b696a6'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.751134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] The token cache is being invalidate because project 955a3969f408414d86f45d26bf350ba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:26:48.751421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.752185 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-f0594b5a-3409-4ccf-8d70-235342b696a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:26:48.753717 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1405/2792] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:26:48 2022] DELETE /identity/v3/projects/955a3969f408414d86f45d26bf350ba7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:48.760123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.760621 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.761053 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.781657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:48.782858 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:48.843745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1388/2793] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:48.851707 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.852018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.852292 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.873525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:48.874851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:48.883197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1406/2794] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:48.888027 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:48.898164 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7dd271-2d19-4cbd-8926-add079c27bec None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:48.903814 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:48.904450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.904731 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.905006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.905658 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:26:48.905965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:48.907567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:48.919566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1389/2795] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:26:48.924225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:48.934416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fbad5-1314-4666-ac2b-a542320f5d77 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:48.940281 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:48.940912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:48.941192 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:48.941442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:48.942087 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:48.944467 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:48.991127 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1407/2796] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:26:48 2022] POST /identity/v3/projects => generated 365 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:26:48.993400 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:49.006113 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5beb06-6390-4cfe-94b8-bd0d4e4c11d5 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:49.026745 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:49.088172 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:49.088813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:49.089090 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:49.089408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:49.090049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:49.091992 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:49.128375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1390/2797] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:26:48 2022] POST /identity/v3/users => generated 283 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:26:49.133186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:49.144835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c083e6b-e96f-4846-ae97-74f6b64d4e82 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:49.149425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:49.150031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:49.150336 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:49.150811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:49.151916 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:49.154658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:49.170013 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1408/2798] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:49.174153 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:49.185791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2911b-845f-4d69-a132-454d0b19a9f1 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:49.194373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f4969-88f1-43a0-a161-e6ad4166467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:49.195086 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f4969-88f1-43a0-a161-e6ad4166467f admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:49.195538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f4969-88f1-43a0-a161-e6ad4166467f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:49.195982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f4969-88f1-43a0-a161-e6ad4166467f admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:49.197343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f4969-88f1-43a0-a161-e6ad4166467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:49.198997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f4969-88f1-43a0-a161-e6ad4166467f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:49.214984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1391/2799] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:26:49.219337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:49.229684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e4023-8eb2-4832-bce2-961df99e191b admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:49.235936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:49.236663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:49.236945 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:49.237220 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] PATH_INFO: `/v3/projects/b0a35917029747b3b0a2e75784f06eb7/users/83fd779adf5944d8ac8b3742ee3162f5/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:49.253887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a35917029747b3b0a2e75784f06eb7, user_id=83fd779adf5944d8ac8b3742ee3162f5, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:49.256532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:49.276705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1409/2800] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:26:49 2022] PUT /identity/v3/projects/b0a35917029747b3b0a2e75784f06eb7/users/83fd779adf5944d8ac8b3742ee3162f5/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:26:49.356385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:49.356385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:49.356385 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:49.394104 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] MFA Rules not processed for user `83fd779adf5944d8ac8b3742ee3162f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:26:49.395398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:49.482437 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1392/2801] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:26:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:26:49.495936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:49.497891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:49.511806 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:26:49.569340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d776acf-7b7c-490b-99d6-381a605a7866 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:49.574487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:49.575363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:49.575650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:49.575920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:49.588747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:49.593668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:49.607231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1410/2802] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:55.790520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:55.791940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:55.803777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75760f3-56a5-4a77-8ce3-0047592e1680 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:55.807251 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:55.807879 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:55.808186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:55.808455 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:55.810130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:55.885456 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:55.887533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421728-8302-41cd-9562-e47068b451c7 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:55.898416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1393/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:26:57.314778 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:26:57.316356 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:57.373197 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa72026-4037-4b24-a507-de3a410de261 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:26:57.378486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:26:57.379091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:26:57.379369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:26:57.379642 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:26:57.381394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:26:57.395853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:26:57.397347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:26:57.408394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1411/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:26:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:27:05.893410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=91,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:07.403752 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=49 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:08.581288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:08.581893 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:08.582122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:08.601865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] MFA Rules not processed for user `e4585bb4f69f416d9f46214ae4126961`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:08.603073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:08.660882 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1394/2805] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:27:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:11.423335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:11.425071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:11.437530 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9a358-10e1-448c-805f-22109b547d33 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:11.441381 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:11.441986 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:11.442261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:11.442533 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:11.444361 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:11.455016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:11.456496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:11.465295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1412/2806] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:12.069994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:12.072932 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:12.093127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fc705-5ea6-45e5-9078-0640144fe8ad None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:12.101037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:12.101721 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:12.101998 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:12.102472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:12.106244 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:12.129712 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:12.132818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:12.145692 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1395/2807] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:21.461274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:22.140763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=31 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:22.394318 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:22.395765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:22.413291 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7224293-113e-412c-ac8e-f636970e8c88 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:22.419320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:22.420380 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:22.420805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:22.421143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:22.423074 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:22.436474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:22.438188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b203-e74d-44c1-849d-a2b6a224cd64 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:22.449705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1413/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:23.980633 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:24.045761 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97f291-31ad-466f-b1fa-73ac95bc8d4f service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:24.050574 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:24.051211 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:24.051492 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:24.051766 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] PATH_INFO: `/v3/users/83fd779adf5944d8ac8b3742ee3162f5` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:24.052982 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=83fd779adf5944d8ac8b3742ee3162f5)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:24.054897 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:24.103782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83fd779adf5944d8ac8b3742ee3162f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.112748 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83fd779adf5944d8ac8b3742ee3162f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.113390 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83fd779adf5944d8ac8b3742ee3162f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.126507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83fd779adf5944d8ac8b3742ee3162f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.127230 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83fd779adf5944d8ac8b3742ee3162f5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.139718 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1396/2809] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:27:23 2022] DELETE /identity/v3/users/83fd779adf5944d8ac8b3742ee3162f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:27:24.144460 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:24.145128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:24.145128 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:24.164952 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:27:24.166655 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:24.228628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1414/2810] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:27:24.239195 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:24.240674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:24.311461 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a98d71-94a1-42d2-984a-cd2515eaa60b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:24.315269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:24.316061 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:24.316338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:24.316606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:24.327836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:24.329755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:24.341273 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1397/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:27:24.632169 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:27:24.633589 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:27:24.647687 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc2111-2d31-4e7e-af5d-0ed39d784d58 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:27:24.653694 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:27:24.654420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:27:24.654705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:27:24.655648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] PATH_INFO: `/v3/projects/b0a35917029747b3b0a2e75784f06eb7` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:27:24.657004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a35917029747b3b0a2e75784f06eb7)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:27:24.658983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:27:24.711075 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a35917029747b3b0a2e75784f06eb7', 'request_id': 'req-01005da9-86d8-43c1-87cf-a78d47025a50'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.717704 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a35917029747b3b0a2e75784f06eb7', 'request_id': 'req-01005da9-86d8-43c1-87cf-a78d47025a50'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.725354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a35917029747b3b0a2e75784f06eb7', 'request_id': 'req-01005da9-86d8-43c1-87cf-a78d47025a50'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.736951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] The token cache is being invalidate because project b0a35917029747b3b0a2e75784f06eb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:27:24.737265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.737932 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-01005da9-86d8-43c1-87cf-a78d47025a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:27:24.739415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1415/2812] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:27:24 2022] DELETE /identity/v3/projects/b0a35917029747b3b0a2e75784f06eb7 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:27:34.335855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:27:34.733542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:37.786955 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:28:37.788727 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:37.865045 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5fe5a-1c84-4421-b4ff-99dc4bde2cbe service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:28:37.940840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:28:37.941459 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:28:37.941742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:28:37.942013 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:28:37.943754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:38.005362 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:28:38.006965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:28:38.016382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1398/2813] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:28:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:28:48.012155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:28:50.438834 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:28:50.439413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:28:50.439413 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:28:50.461032 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] MFA Rules not processed for user `e4585bb4f69f416d9f46214ae4126961`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:28:50.462262 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:50.469282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1416/2814] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:28:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:28:51.139631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:28:51.141205 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:51.226269 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fdcc5-9c2d-418a-af4b-a7134e701d3e service nova] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:28:51.232526 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:28:51.233123 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:28:51.233398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:28:51.233665 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:28:51.235344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:51.247552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:28:51.249124 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:28:51.258965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1399/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:28:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:28:59.287182 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:28:59.288972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:59.312322 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5426987-96ac-4faa-a4bf-9f0a71207a7f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:28:59.318177 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e1da264bfb8e41589f88d2e84528d92d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:28:59.318884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:28:59.319256 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:28:59.319889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:28:59.321648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:28:59.337899 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:28:59.339724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:28:59.353691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1417/2816] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:28:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:29:01.254810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=32 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:29:09.349016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=9 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:26.914187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:26.915737 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.936993 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229594d-63e5-44d4-90b3-ee24e3dcf30c service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:26.942572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:26.943188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:26.943475 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:26.944292 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:26.945617 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:26.961187 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:26.962896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:26.974449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1400/2817] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:33.007313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:33.008779 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:33.067274 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9c672-f508-4494-a7e9-f62dc10aad33 service nova] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:33.070983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:33.071597 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:33.071876 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:33.072179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:33.073975 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:33.146294 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:33.147681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:33.158564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1418/2818] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:36.690233 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:36.705079 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7fd969-d31d-484f-8bb3-f9eb2315923b service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:36.712776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:36.713667 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.713983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.714340 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.717115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.734656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:36.737261 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:36.757735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:36.759239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1401/2819] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:36.760188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:36.773313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a064a-d784-4f28-8481-5fb55d5788eb service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:36.778340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:36.778983 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:36.779266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:36.779643 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] PATH_INFO: `/v3/users/e4585bb4f69f416d9f46214ae4126961` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:36.780924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4585bb4f69f416d9f46214ae4126961)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:36.783062 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:36.832470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4585bb4f69f416d9f46214ae4126961'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.839787 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4585bb4f69f416d9f46214ae4126961'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.840486 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4585bb4f69f416d9f46214ae4126961'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.841159 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4585bb4f69f416d9f46214ae4126961'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.853537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dea402e2-2ecd-4df9-a6f8-261f3f553ea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4585bb4f69f416d9f46214ae4126961'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:36.866335 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1419/2820] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:36 2022] DELETE /identity/v3/users/e4585bb4f69f416d9f46214ae4126961 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:37.054965 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.066639 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3d9f0-7234-4aa9-a44f-900bf2d83853 service placement] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.130080 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.130646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.130931 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.131247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] PATH_INFO: `/v3/projects/53c5c16a2f064e3c801a200197e8a7ce` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.132436 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53c5c16a2f064e3c801a200197e8a7ce)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.134354 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.180595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53c5c16a2f064e3c801a200197e8a7ce', 'request_id': 'req-353f4c97-0f03-4a46-aca1-f756d03cf574'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.186119 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53c5c16a2f064e3c801a200197e8a7ce', 'request_id': 'req-353f4c97-0f03-4a46-aca1-f756d03cf574'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.192282 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53c5c16a2f064e3c801a200197e8a7ce', 'request_id': 'req-353f4c97-0f03-4a46-aca1-f756d03cf574'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.205235 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] The token cache is being invalidate because project 53c5c16a2f064e3c801a200197e8a7ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:37.205524 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.206948 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-353f4c97-0f03-4a46-aca1-f756d03cf574 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:37.207694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1402/2821] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:37 2022] DELETE /identity/v3/projects/53c5c16a2f064e3c801a200197e8a7ce => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:37.213905 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.214195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.214471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.234429 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:37.236266 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:37.253026 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:37.296886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1420/2822] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:37.306397 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.306682 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.306959 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.327555 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:37.328809 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:37.337457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1403/2823] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:37.341641 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.351987 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f4f8d-1a33-45d2-bcab-c77604017338 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.356833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.357434 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.357710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.357976 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.358616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:37.358936 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.360575 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.372214 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1421/2824] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:37.376769 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.385970 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55037b57-700e-4ba3-9db0-34f9229de6b1 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.390629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.391215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.391488 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.392281 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.392906 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.394767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.425149 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1404/2825] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:37.429473 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.440038 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b4c2a8-e31e-4d7a-b1b1-fbe15c09d1c1 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.496060 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.496663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.496942 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.497211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.497845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.499784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.520657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1422/2826] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:37.524905 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.535711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873ec96-db0f-4cdb-bacb-54c56684a36e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.540364 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.540951 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.541231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.541503 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.542141 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.543733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.554081 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1405/2827] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:37.558004 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.567925 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33cd5a-4a22-4eb1-981a-d3256053ac9c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.572920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838920fa-ef0a-4070-8942-72d8314d8315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.573539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838920fa-ef0a-4070-8942-72d8314d8315 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.573844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838920fa-ef0a-4070-8942-72d8314d8315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.574265 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838920fa-ef0a-4070-8942-72d8314d8315 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.574949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838920fa-ef0a-4070-8942-72d8314d8315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.576635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838920fa-ef0a-4070-8942-72d8314d8315 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.588858 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1423/2828] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:37.593083 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.603800 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f974c138-bbd2-4360-8927-3928101a9109 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.609017 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.609669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.609949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.610225 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] PATH_INFO: `/v3/projects/acdfc63065c14aee8b962d837f5fa9c1/users/a5d2c5c9a90e4bd7bc3298cda9e1856e/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.625855 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdfc63065c14aee8b962d837f5fa9c1, user_id=a5d2c5c9a90e4bd7bc3298cda9e1856e, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.628533 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.638369 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:37.644130 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1406/2829] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:37 2022] PUT /identity/v3/projects/acdfc63065c14aee8b962d837f5fa9c1/users/a5d2c5c9a90e4bd7bc3298cda9e1856e/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:37.655751 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.656068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.656346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.687577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] MFA Rules not processed for user `a5d2c5c9a90e4bd7bc3298cda9e1856e`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:37.689442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:37.761111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1424/2830] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:37.765445 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.830753 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a917f42d-b2ad-4dac-a6c2-1c561ec80c73 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.835775 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.836494 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.836836 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.837173 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.837872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.839818 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.868249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1407/2831] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:37.872635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.883648 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbb43b-daa9-4e1a-b4eb-c855dfb01922 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.896878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:37.945543 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.946145 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.946432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.946698 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.947320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.949309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:37.971562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1425/2832] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:37 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:37.975586 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:37.986349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a734ec-18fe-481f-9904-a1fe20e3b4ca admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:37.991127 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:37.991725 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:37.992040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:37.992312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:37.992950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:37.994622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.006036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1408/2833] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:38.010108 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.020134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222268e-fe2f-448b-937f-2282099ce739 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.024743 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.025394 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.025673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.026086 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] PATH_INFO: `/v3/projects/43f3fb9fa1674534a48e71fe1202d8da/users/2171f1e13f6b4802b39e1b9c1de1672d/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.049563 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f3fb9fa1674534a48e71fe1202d8da, user_id=2171f1e13f6b4802b39e1b9c1de1672d, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.052295 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.065239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1426/2834] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:38 2022] PUT /identity/v3/projects/43f3fb9fa1674534a48e71fe1202d8da/users/2171f1e13f6b4802b39e1b9c1de1672d/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:38.069188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.079566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d4b3b-68c4-4303-ad0a-6799ca7fdf4a admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.134428 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c6c7c-4af2-4190-a834-8f011a73416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.135026 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c6c7c-4af2-4190-a834-8f011a73416c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.135303 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c6c7c-4af2-4190-a834-8f011a73416c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.135570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c6c7c-4af2-4190-a834-8f011a73416c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.136231 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c6c7c-4af2-4190-a834-8f011a73416c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.137812 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c6c7c-4af2-4190-a834-8f011a73416c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.147835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1409/2835] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:30:38.152061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.163378 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378003c5-3640-4839-9320-46af71cf98ef admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.168615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.169275 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.169562 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.169831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] PATH_INFO: `/v3/projects/43f3fb9fa1674534a48e71fe1202d8da/users/2171f1e13f6b4802b39e1b9c1de1672d/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.171800 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f3fb9fa1674534a48e71fe1202d8da, user_id=2171f1e13f6b4802b39e1b9c1de1672d, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.175258 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.186421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1427/2836] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:38 2022] PUT /identity/v3/projects/43f3fb9fa1674534a48e71fe1202d8da/users/2171f1e13f6b4802b39e1b9c1de1672d/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:38.197457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.197909 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.198258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.231782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] MFA Rules not processed for user `2171f1e13f6b4802b39e1b9c1de1672d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:38.233837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.292609 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:38.303501 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1410/2837] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:38.316588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:38.318297 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:38.374660 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4621e26a-beb4-4ae4-938b-a45fa69d5249 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:38.378854 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:38.379441 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:38.379716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:38.380011 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:38.439231 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:38.440673 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:38.449596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1428/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:39.808619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:39.810020 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:39.822974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3182e-b7f3-480b-8aa0-c569f6f42a44 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:39.826645 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede068d-2365-4cb5-9788-6f142b9d1407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:39.827265 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede068d-2365-4cb5-9788-6f142b9d1407 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:39.827565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede068d-2365-4cb5-9788-6f142b9d1407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:39.827977 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede068d-2365-4cb5-9788-6f142b9d1407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:39.837382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede068d-2365-4cb5-9788-6f142b9d1407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:39.838816 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede068d-2365-4cb5-9788-6f142b9d1407 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:39.848610 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1411/2839] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:43.599818 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.627665 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:43.664209 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dbf736-dd88-4ace-a7ca-20f6e94e1f09 service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.668683 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.669331 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.669611 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.669887 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] PATH_INFO: `/v3/users/a5d2c5c9a90e4bd7bc3298cda9e1856e` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.670998 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5d2c5c9a90e4bd7bc3298cda9e1856e)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.673722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.721459 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5d2c5c9a90e4bd7bc3298cda9e1856e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:43.729633 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5d2c5c9a90e4bd7bc3298cda9e1856e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:43.730345 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5d2c5c9a90e4bd7bc3298cda9e1856e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:43.731008 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5d2c5c9a90e4bd7bc3298cda9e1856e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:43.743637 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5d2c5c9a90e4bd7bc3298cda9e1856e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:43.756390 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1429/2840] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:43 2022] DELETE /identity/v3/users/a5d2c5c9a90e4bd7bc3298cda9e1856e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:43.761007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.761477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.761583 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.780112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:43.781321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:43.840312 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1412/2841] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:43.851094 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:43.852539 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:43.910307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea379ee-b135-4276-b52d-9caa5247dcda admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:43.914144 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:43.914750 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:43.915043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:43.915334 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:43.925631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:43.927070 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:43.936647 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1430/2842] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:44.212229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.213742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.228774 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd70d-fbab-4e2e-a806-c2946b6613d5 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.233756 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.234394 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.234674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.234950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] PATH_INFO: `/v3/projects/acdfc63065c14aee8b962d837f5fa9c1` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.237001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdfc63065c14aee8b962d837f5fa9c1)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.238984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.287730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdfc63065c14aee8b962d837f5fa9c1', 'request_id': 'req-7edb2ace-b2ad-4cac-becc-b64d159721bf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.293331 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdfc63065c14aee8b962d837f5fa9c1', 'request_id': 'req-7edb2ace-b2ad-4cac-becc-b64d159721bf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.300095 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdfc63065c14aee8b962d837f5fa9c1', 'request_id': 'req-7edb2ace-b2ad-4cac-becc-b64d159721bf'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.314246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] The token cache is being invalidate because project acdfc63065c14aee8b962d837f5fa9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:44.314538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.315171 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.316691 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1413/2843] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:44 2022] DELETE /identity/v3/projects/acdfc63065c14aee8b962d837f5fa9c1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 31 12:30:44.320817 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.331312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ba7a3-3c8b-4bcc-89ed-cf05a55071e5 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.374736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:44.389982 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.390608 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.390886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.391261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] PATH_INFO: `/v3/users/2171f1e13f6b4802b39e1b9c1de1672d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.392912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=2171f1e13f6b4802b39e1b9c1de1672d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.394835 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.441406 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2171f1e13f6b4802b39e1b9c1de1672d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.448111 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2171f1e13f6b4802b39e1b9c1de1672d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.448731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2171f1e13f6b4802b39e1b9c1de1672d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.449339 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2171f1e13f6b4802b39e1b9c1de1672d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.461693 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-fe2e08c9-d687-45d7-b84c-b571b5ded3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2171f1e13f6b4802b39e1b9c1de1672d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.473457 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1431/2844] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:44 2022] DELETE /identity/v3/users/2171f1e13f6b4802b39e1b9c1de1672d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:44.748181 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:44.749910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.765683 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edb2ace-b2ad-4cac-becc-b64d159721bf admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:44.824155 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:44.824805 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.825077 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.825328 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] PATH_INFO: `/v3/projects/43f3fb9fa1674534a48e71fe1202d8da` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.826468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f3fb9fa1674534a48e71fe1202d8da)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:44.828398 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:44.837324 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:44.877350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f3fb9fa1674534a48e71fe1202d8da', 'request_id': 'req-3988a483-3d6a-4c9d-90f9-0488d94159a8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.882872 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f3fb9fa1674534a48e71fe1202d8da', 'request_id': 'req-3988a483-3d6a-4c9d-90f9-0488d94159a8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.888962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f3fb9fa1674534a48e71fe1202d8da', 'request_id': 'req-3988a483-3d6a-4c9d-90f9-0488d94159a8'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.902608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] The token cache is being invalidate because project 43f3fb9fa1674534a48e71fe1202d8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:44.902896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.903507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-3988a483-3d6a-4c9d-90f9-0488d94159a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:44.905002 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1414/2845] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:44 2022] DELETE /identity/v3/projects/43f3fb9fa1674534a48e71fe1202d8da => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:44.910482 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:44.911006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:44.911006 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:44.930962 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:44.932191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:44.992204 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1432/2846] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:45.000587 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.001541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.001844 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.021537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:45.022750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.030735 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1415/2847] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:45.034949 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.044572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6f7c-70a9-494c-a909-e0434e6e39f7 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.049598 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.050195 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.050475 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.050748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.051395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:45.051696 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.053337 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.065326 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1433/2848] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:45.069973 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.079768 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d606a78f-1cd0-4f2f-8c89-5538242f4bd7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.084462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.085293 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.085590 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.085864 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.086489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.088631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.116146 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1416/2849] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:45.120500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.131049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6457d0b-6363-4666-bc66-f70bff833b11 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.177332 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:45.189425 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.190028 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.190308 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.190574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.191211 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.193167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.214237 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1434/2850] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:30:45.218519 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.229203 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913eeb38-f72f-45a9-bea3-c9783ad222fa admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.234912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.236122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.236399 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.237520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.237520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.238899 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.249258 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1417/2851] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:45.253474 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.263487 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83315a1-4472-4c71-a7ef-5eede5bfe086 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.268019 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1113b-5d4f-4e49-85d1-2ca615a23674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.268605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1113b-5d4f-4e49-85d1-2ca615a23674 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.268879 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1113b-5d4f-4e49-85d1-2ca615a23674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.269147 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1113b-5d4f-4e49-85d1-2ca615a23674 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.269781 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1113b-5d4f-4e49-85d1-2ca615a23674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.271369 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1113b-5d4f-4e49-85d1-2ca615a23674 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.281016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1435/2852] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:45.285675 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.295537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2198-3bd1-4a49-a008-d61a778c8e42 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.300773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.301418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.301709 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.301962 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] PATH_INFO: `/v3/projects/b8360e77b3a04d648bff070a843a429f/users/2869e05a13304d10b9ca843b5354a074/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.316811 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8360e77b3a04d648bff070a843a429f, user_id=2869e05a13304d10b9ca843b5354a074, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.319452 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.332896 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1418/2853] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:45 2022] PUT /identity/v3/projects/b8360e77b3a04d648bff070a843a429f/users/2869e05a13304d10b9ca843b5354a074/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:45.344358 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.345167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.345415 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.373626 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] MFA Rules not processed for user `2869e05a13304d10b9ca843b5354a074`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:45.374865 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.440282 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1436/2854] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:45.444846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.506616 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902bcb7-e285-4810-9919-cce02b293e63 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.515284 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.515892 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.516199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.516468 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.517711 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.519629 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.546220 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1419/2855] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:45.550951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.561873 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b667d98-a758-439b-8f45-75debbe5d82d None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.619935 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.620564 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.620846 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.621116 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.621744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.623664 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.644724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1437/2856] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:45.648890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.659290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c99a14-3ed6-4d29-a867-be7438e9d913 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.663937 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.664622 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.664902 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.665246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.665936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.667684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.678949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1420/2857] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:45.683123 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.693679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26278a3-83e6-4523-b9dd-ae1491d8d8fc admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.698444 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.699089 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.699364 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.699635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] PATH_INFO: `/v3/projects/062eb974f04b4ccaa6de8e94d01ce0e3/users/e8daec35d9fa4649ba861a6240a2198f/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.714392 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062eb974f04b4ccaa6de8e94d01ce0e3, user_id=e8daec35d9fa4649ba861a6240a2198f, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.717102 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.730173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1438/2858] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:45 2022] PUT /identity/v3/projects/062eb974f04b4ccaa6de8e94d01ce0e3/users/e8daec35d9fa4649ba861a6240a2198f/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:45.734117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.744657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00886adf-91d1-4564-8a5d-6b9208dd158c admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.748249 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:45.802961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137d3d5-e397-42d2-89ea-ed5014213494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.803618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137d3d5-e397-42d2-89ea-ed5014213494 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.803820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137d3d5-e397-42d2-89ea-ed5014213494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.804122 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137d3d5-e397-42d2-89ea-ed5014213494 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.804754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137d3d5-e397-42d2-89ea-ed5014213494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.806387 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137d3d5-e397-42d2-89ea-ed5014213494 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.816847 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1421/2859] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:45.821347 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.832716 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a4c827-62d0-495d-9471-fe2c0775fb16 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:45.837674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:45.838354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.838654 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.838923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] PATH_INFO: `/v3/projects/062eb974f04b4ccaa6de8e94d01ce0e3/users/e8daec35d9fa4649ba861a6240a2198f/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.840886 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=062eb974f04b4ccaa6de8e94d01ce0e3, user_id=e8daec35d9fa4649ba861a6240a2198f, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:45.843584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:45.853843 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1439/2860] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:45 2022] PUT /identity/v3/projects/062eb974f04b4ccaa6de8e94d01ce0e3/users/e8daec35d9fa4649ba861a6240a2198f/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:45.864637 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:45.864921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:45.865194 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:45.892541 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] MFA Rules not processed for user `e8daec35d9fa4649ba861a6240a2198f`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:45.893763 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.961572 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1422/2861] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:45.973840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:45.975668 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:45.991110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:46.034816 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9307291-298d-499e-b7cf-c2c5ee41ff4c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.038541 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499a6cf-587d-497d-9257-67560939d59d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.039141 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499a6cf-587d-497d-9257-67560939d59d service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.039414 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499a6cf-587d-497d-9257-67560939d59d service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.039681 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499a6cf-587d-497d-9257-67560939d59d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.049066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499a6cf-587d-497d-9257-67560939d59d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.050619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499a6cf-587d-497d-9257-67560939d59d service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.060284 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1440/2862] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:45 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:46.642401 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.704845 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac74232-e68f-43e4-9e49-2dc568d0b2bb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.709388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.710007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.710288 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.710560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] PATH_INFO: `/v3/users/2869e05a13304d10b9ca843b5354a074` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.711791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2869e05a13304d10b9ca843b5354a074)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.713631 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.754037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:46.768964 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2869e05a13304d10b9ca843b5354a074'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.776101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2869e05a13304d10b9ca843b5354a074'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.776777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2869e05a13304d10b9ca843b5354a074'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.789024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2869e05a13304d10b9ca843b5354a074'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.789699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2869e05a13304d10b9ca843b5354a074'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:46.803409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1423/2863] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:46 2022] DELETE /identity/v3/users/2869e05a13304d10b9ca843b5354a074 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:46.807924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.808272 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.808574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.827810 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:46.829154 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.891618 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1441/2864] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:46.901309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:46.902875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:46.964946 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66318041-11e2-42e8-8664-86197bd6e064 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:46.968754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:46.969410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:46.970241 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:46.970507 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:46.980291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:46.981851 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:46.992865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1424/2865] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:47.293439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:47.295023 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.311061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ca1ce-d379-49c8-9466-5d21aa525243 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:47.316929 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:47.317576 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.317993 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.318273 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] PATH_INFO: `/v3/projects/b8360e77b3a04d648bff070a843a429f` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.319432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8360e77b3a04d648bff070a843a429f)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.321443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.369813 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8360e77b3a04d648bff070a843a429f', 'request_id': 'req-d1e12719-9361-4b50-88a4-4a6fb35a322c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.376773 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8360e77b3a04d648bff070a843a429f', 'request_id': 'req-d1e12719-9361-4b50-88a4-4a6fb35a322c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.385484 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8360e77b3a04d648bff070a843a429f', 'request_id': 'req-d1e12719-9361-4b50-88a4-4a6fb35a322c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.397657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] The token cache is being invalidate because project b8360e77b3a04d648bff070a843a429f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:47.397938 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.398588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.400143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1442/2866] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:47 2022] DELETE /identity/v3/projects/b8360e77b3a04d648bff070a843a429f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:47.404200 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:47.414750 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b1543-ad6c-4d55-848a-a5bbf141e9e1 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:47.475093 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:47.475754 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.476096 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.476350 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] PATH_INFO: `/v3/users/e8daec35d9fa4649ba861a6240a2198f` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.477481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8daec35d9fa4649ba861a6240a2198f)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.479380 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.527298 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8daec35d9fa4649ba861a6240a2198f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.531409 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:47.537373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8daec35d9fa4649ba861a6240a2198f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.538084 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8daec35d9fa4649ba861a6240a2198f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.552381 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8daec35d9fa4649ba861a6240a2198f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.553036 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-736e1032-a936-4b79-a7fb-22970fa35401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8daec35d9fa4649ba861a6240a2198f'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.565209 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1425/2867] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:47 2022] DELETE /identity/v3/users/e8daec35d9fa4649ba861a6240a2198f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:47.838844 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:47.840878 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:47.855828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e12719-9361-4b50-88a4-4a6fb35a322c admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:47.905695 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:47.930061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:47.930710 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:47.930991 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:47.931270 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] PATH_INFO: `/v3/projects/062eb974f04b4ccaa6de8e94d01ce0e3` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:47.932612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=062eb974f04b4ccaa6de8e94d01ce0e3)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:47.934584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:47.992362 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062eb974f04b4ccaa6de8e94d01ce0e3', 'request_id': 'req-dfdf7589-2ed7-463a-8972-b32ffe0322a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:47.999992 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062eb974f04b4ccaa6de8e94d01ce0e3', 'request_id': 'req-dfdf7589-2ed7-463a-8972-b32ffe0322a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.007677 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062eb974f04b4ccaa6de8e94d01ce0e3', 'request_id': 'req-dfdf7589-2ed7-463a-8972-b32ffe0322a0'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.019502 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] The token cache is being invalidate because project 062eb974f04b4ccaa6de8e94d01ce0e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:48.019789 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.020494 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-dfdf7589-2ed7-463a-8972-b32ffe0322a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:48.022049 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1443/2868] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:47 2022] DELETE /identity/v3/projects/062eb974f04b4ccaa6de8e94d01ce0e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:48.027115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.027624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.027624 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.048075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:48.049296 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:48.108413 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1426/2869] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:48.116296 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.116578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.116851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.136848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:48.138039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:48.146829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1444/2870] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:48.151438 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.161199 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9c0c4-b646-464e-940c-e85131860d3f None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.166217 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.166595 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.166863 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.167135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.167783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:48.168118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.169724 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.181921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1427/2871] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 31 12:30:48.186261 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.196083 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471eeaa-a1ba-4fc7-9694-b4d404c96ff1 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.200829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.201438 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.201747 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.202016 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.202646 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.204853 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.232767 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1445/2872] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:48.237640 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.247752 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d47991-a18c-4ab7-8d51-ed9da40af919 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.304056 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.304901 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.305357 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.305710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.306384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.308449 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.328938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1428/2873] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:48.333421 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.343657 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e972daaa-c94d-4d24-b4f8-d7eacd992fb0 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.348765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.349354 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.349630 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.349898 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.350551 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.352186 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.362599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1446/2874] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:48.366453 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.376560 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bfbd4-25e9-4a40-b24e-fedcfe321ce3 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.381419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d92691-c047-4090-9858-1e87663332ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.382009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92691-c047-4090-9858-1e87663332ff admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.382286 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92691-c047-4090-9858-1e87663332ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.382557 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d92691-c047-4090-9858-1e87663332ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.383191 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d92691-c047-4090-9858-1e87663332ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.384888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d92691-c047-4090-9858-1e87663332ff admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.395408 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1429/2875] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:48.399500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.410047 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02c42c-a275-406b-9ab8-979b1185f3db admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.414884 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.415566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.415849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.416173 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] PATH_INFO: `/v3/projects/87c84bc8381a47c2b385c755145fc760/users/2299b56ad693422da935096917a9d01d/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.431247 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87c84bc8381a47c2b385c755145fc760, user_id=2299b56ad693422da935096917a9d01d, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.433923 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.451191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1447/2876] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:48 2022] PUT /identity/v3/projects/87c84bc8381a47c2b385c755145fc760/users/2299b56ad693422da935096917a9d01d/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:48.528368 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.528643 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.528910 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.556945 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] MFA Rules not processed for user `2299b56ad693422da935096917a9d01d`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:48.558148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:48.582246 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:48.624302 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1430/2877] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:48.628856 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.691911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb929a-0a19-41d6-9091-7a7c41379888 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.696700 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.697298 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.697578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.697845 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.698469 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.700398 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.711463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:48.729989 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1448/2878] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:48.734100 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.745349 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890175d-913e-495c-b60c-ba3d9bb24c0d None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.801075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.801687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.801972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.802240 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.802881 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.804829 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.827592 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1431/2879] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:48 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:48.831972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.843725 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae00a58-5223-4214-86cc-ec8d483ac5b8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.848734 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.849537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.849815 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.850084 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.850722 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.852424 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.863463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1449/2880] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:48.867611 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.878188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42ca64-d5fc-4fd5-b846-3a005c335c29 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.882646 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.883287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.883563 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.883832 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] PATH_INFO: `/v3/projects/a009c8d4e42447af9d34729fe90454ff/users/fe93f737036b4a4b9ef57424c708b89c/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.898219 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a009c8d4e42447af9d34729fe90454ff, user_id=fe93f737036b4a4b9ef57424c708b89c, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.900883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:48.913793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1432/2881] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:48 2022] PUT /identity/v3/projects/a009c8d4e42447af9d34729fe90454ff/users/fe93f737036b4a4b9ef57424c708b89c/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:48.917823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:48.931233 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a621a8a-75b6-4179-9d90-3243087341d4 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:48.988232 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235e6fe-fe0e-4c38-84ea-ede683ac6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:48.988828 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e6fe-fe0e-4c38-84ea-ede683ac6f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:48.990079 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e6fe-fe0e-4c38-84ea-ede683ac6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:48.990357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235e6fe-fe0e-4c38-84ea-ede683ac6f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:48.991027 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235e6fe-fe0e-4c38-84ea-ede683ac6f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:48.992731 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235e6fe-fe0e-4c38-84ea-ede683ac6f7d admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.002588 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1450/2882] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:49.006885 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.017520 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248542a-1506-45f0-97e3-bda8a794ca6f admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.022373 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.023019 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.023323 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.023618 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] PATH_INFO: `/v3/projects/a009c8d4e42447af9d34729fe90454ff/users/fe93f737036b4a4b9ef57424c708b89c/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.025779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a009c8d4e42447af9d34729fe90454ff, user_id=fe93f737036b4a4b9ef57424c708b89c, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.028470 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.039384 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1433/2883] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:49 2022] PUT /identity/v3/projects/a009c8d4e42447af9d34729fe90454ff/users/fe93f737036b4a4b9ef57424c708b89c/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:49.050205 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.050511 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.050802 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.077995 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] MFA Rules not processed for user `fe93f737036b4a4b9ef57424c708b89c`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:49.079202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.147699 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1451/2884] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:49 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:49.159135 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.160846 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.218779 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2bcc-5e18-408f-89d4-9ecd49582e95 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.222907 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51c898-d73c-42b7-a152-44496a37ca7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.223504 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c898-d73c-42b7-a152-44496a37ca7b service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.223777 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c898-d73c-42b7-a152-44496a37ca7b service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.224075 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51c898-d73c-42b7-a152-44496a37ca7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.232870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51c898-d73c-42b7-a152-44496a37ca7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.234283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e51c898-d73c-42b7-a152-44496a37ca7b service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.244143 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1434/2885] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:49.615831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.677054 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43073dc-1b0b-4904-9dc7-43e1115d5a39 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.681737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.682360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.682658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.682927 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] PATH_INFO: `/v3/users/2299b56ad693422da935096917a9d01d` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.684081 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2299b56ad693422da935096917a9d01d)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.686068 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.689375 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:49.735829 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2299b56ad693422da935096917a9d01d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.743849 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2299b56ad693422da935096917a9d01d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.744496 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2299b56ad693422da935096917a9d01d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.745106 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2299b56ad693422da935096917a9d01d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.757409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2299b56ad693422da935096917a9d01d'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:49.769906 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1452/2886] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:49 2022] DELETE /identity/v3/users/2299b56ad693422da935096917a9d01d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:49.774567 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.774857 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.775133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.795272 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:49.796490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.809237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:49.858290 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1435/2887] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:49.868226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:49.869628 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:49.928674 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12527a7-6459-4b9e-bf85-07bf53c9e98f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:49.932453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:49.933470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:49.933775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:49.934082 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:49.943567 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:49.945076 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:49.955508 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1453/2888] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:30:50.227961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:50.229001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:50.243109 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd64845-4fb9-49b2-a027-4a44f801a7f9 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:50.247890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:50.248597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:50.248875 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:50.249142 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] PATH_INFO: `/v3/projects/87c84bc8381a47c2b385c755145fc760` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:50.250278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=87c84bc8381a47c2b385c755145fc760)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:50.252279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:50.305708 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87c84bc8381a47c2b385c755145fc760', 'request_id': 'req-0c735d19-76da-40b0-abfc-071972d52d5d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.316740 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87c84bc8381a47c2b385c755145fc760', 'request_id': 'req-0c735d19-76da-40b0-abfc-071972d52d5d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.328431 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87c84bc8381a47c2b385c755145fc760', 'request_id': 'req-0c735d19-76da-40b0-abfc-071972d52d5d'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.342630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] The token cache is being invalidate because project 87c84bc8381a47c2b385c755145fc760 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:50.342927 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.343940 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.346117 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1436/2889] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:50 2022] DELETE /identity/v3/projects/87c84bc8381a47c2b385c755145fc760 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:50.350260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:50.359911 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ffbf4-9295-4a09-ae1f-0778727fc122 service neutron] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:50.421964 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:50.422607 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:50.422893 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:50.423165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] PATH_INFO: `/v3/users/fe93f737036b4a4b9ef57424c708b89c` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:50.424411 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe93f737036b4a4b9ef57424c708b89c)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:50.426350 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:50.460443 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:50.482191 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe93f737036b4a4b9ef57424c708b89c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.490063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe93f737036b4a4b9ef57424c708b89c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.490691 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe93f737036b4a4b9ef57424c708b89c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.491309 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe93f737036b4a4b9ef57424c708b89c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.504100 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-99012b25-06d2-4eff-b19a-b96d2caf00ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe93f737036b4a4b9ef57424c708b89c'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.517518 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1454/2890] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:30:50 2022] DELETE /identity/v3/users/fe93f737036b4a4b9ef57424c708b89c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:50.789283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:50.790702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:50.804674 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c735d19-76da-40b0-abfc-071972d52d5d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:50.868118 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:50.868744 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:50.869024 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:50.869299 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] PATH_INFO: `/v3/projects/a009c8d4e42447af9d34729fe90454ff` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:50.870483 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a009c8d4e42447af9d34729fe90454ff)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:50.872585 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:50.919034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:50.923257 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a009c8d4e42447af9d34729fe90454ff', 'request_id': 'req-b24447b4-5c86-45f4-8444-4aab91e1ad3b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.930440 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a009c8d4e42447af9d34729fe90454ff', 'request_id': 'req-b24447b4-5c86-45f4-8444-4aab91e1ad3b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.936961 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a009c8d4e42447af9d34729fe90454ff', 'request_id': 'req-b24447b4-5c86-45f4-8444-4aab91e1ad3b'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.951064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] The token cache is being invalidate because project a009c8d4e42447af9d34729fe90454ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:30:50.951355 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.952147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-b24447b4-5c86-45f4-8444-4aab91e1ad3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:30:50.953672 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1437/2891] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:30:50 2022] DELETE /identity/v3/projects/a009c8d4e42447af9d34729fe90454ff => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:50.959631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:50.959631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:50.959631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:50.979200 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:50.980436 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.039031 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1455/2892] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:51.048500 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.048784 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.049054 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.069344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:51.070552 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.078502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1438/2893] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:30:51.083091 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.092768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4315d5f9-4c52-41fe-9c5e-4be9b1e18da4 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.097344 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.097943 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.098225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.098498 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.099142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:30:51.099445 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.101085 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.113149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1456/2894] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:30:51.117521 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.127356 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19ec0f3-8bda-4ce8-bb18-6c313092ef89 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.132186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.132786 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.133069 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.133344 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.133976 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.135911 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.162489 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1439/2895] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:51.166570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.176978 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e46c4-2cf6-4370-8d56-227de4e3e542 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.234161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.234765 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.235043 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.235912 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.236590 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.238500 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.259653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1457/2896] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:30:51.263826 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.274043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036b264-d8a6-4800-8701-787283f24bbc admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.278620 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.279215 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.279495 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.279767 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.280441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.282599 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.293804 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1440/2897] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:51.298509 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.308631 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f939f4a-1fa7-49c9-b67b-67d3872a490f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.313280 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4d275-c1ba-4ec1-8ce1-37a7a4b15497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.313877 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d275-c1ba-4ec1-8ce1-37a7a4b15497 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.314158 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d275-c1ba-4ec1-8ce1-37a7a4b15497 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.314857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4d275-c1ba-4ec1-8ce1-37a7a4b15497 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.315061 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4d275-c1ba-4ec1-8ce1-37a7a4b15497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.316709 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4d275-c1ba-4ec1-8ce1-37a7a4b15497 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.327225 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1458/2898] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:30:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:30:51.331972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.342448 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6859f07d-1383-4bde-8d24-1faa1e18389d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.348126 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.348770 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.349051 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.349321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] PATH_INFO: `/v3/projects/a41bbf6d58c04b90b3b9bfb50907aaad/users/01cb03b1ce4f48e4aafb321a7a4a3c84/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.364407 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a41bbf6d58c04b90b3b9bfb50907aaad, user_id=01cb03b1ce4f48e4aafb321a7a4a3c84, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.367177 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.381291 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1441/2899] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:30:51 2022] PUT /identity/v3/projects/a41bbf6d58c04b90b3b9bfb50907aaad/users/01cb03b1ce4f48e4aafb321a7a4a3c84/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:30:51.391848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.392161 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.392442 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.412439 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:30:51.422517 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] MFA Rules not processed for user `01cb03b1ce4f48e4aafb321a7a4a3c84`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:30:51.424658 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.488537 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1459/2900] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:30:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:30:51.502402 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:30:51.504237 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:30:51.560619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e91d3c-b337-4ceb-b3a8-aa95b331dbf4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:30:51.565201 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90373dfc-0bc1-4345-a5e3-8b6d9b007434 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:30:51.566037 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373dfc-0bc1-4345-a5e3-8b6d9b007434 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:30:51.566321 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373dfc-0bc1-4345-a5e3-8b6d9b007434 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:30:51.566597 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90373dfc-0bc1-4345-a5e3-8b6d9b007434 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:30:51.576942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90373dfc-0bc1-4345-a5e3-8b6d9b007434 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:30:51.578388 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90373dfc-0bc1-4345-a5e3-8b6d9b007434 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:30:51.587820 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1442/2901] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:30:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:01.485368 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=28 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:01.583644 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:04.133525 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.196791 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d39ddb-8552-4d20-a4da-b1904a30f17f None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.201431 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.202056 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.202338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.202612 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] PATH_INFO: `/v3/users/01cb03b1ce4f48e4aafb321a7a4a3c84` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.203857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01cb03b1ce4f48e4aafb321a7a4a3c84)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.206150 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.255321 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01cb03b1ce4f48e4aafb321a7a4a3c84'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.262833 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01cb03b1ce4f48e4aafb321a7a4a3c84'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.263739 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01cb03b1ce4f48e4aafb321a7a4a3c84'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.264616 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01cb03b1ce4f48e4aafb321a7a4a3c84'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.277176 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01cb03b1ce4f48e4aafb321a7a4a3c84'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.290401 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1460/2902] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:04 2022] DELETE /identity/v3/users/01cb03b1ce4f48e4aafb321a7a4a3c84 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:04.295112 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.295630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.295733 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.315279 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:04.316514 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:04.382866 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1443/2903] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:04.393313 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.394730 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:04.457427 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698156b1-9a65-40d5-8f3e-f01e68d812d6 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.461338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982e4a3-9b0a-4e23-8e93-11924dc7c992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.461951 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982e4a3-9b0a-4e23-8e93-11924dc7c992 service neutron] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.462248 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982e4a3-9b0a-4e23-8e93-11924dc7c992 service neutron] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.462546 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982e4a3-9b0a-4e23-8e93-11924dc7c992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.473532 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982e4a3-9b0a-4e23-8e93-11924dc7c992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.475039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7982e4a3-9b0a-4e23-8e93-11924dc7c992 service neutron] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.485547 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1461/2904] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:04.764206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:04.765789 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:04.779131 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836e58d-d73c-4e4c-87c0-eaf9b8736ef2 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:04.783912 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:04.784596 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.784878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.785148 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] PATH_INFO: `/v3/projects/a41bbf6d58c04b90b3b9bfb50907aaad` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.786304 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a41bbf6d58c04b90b3b9bfb50907aaad)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:04.788278 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:04.845105 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a41bbf6d58c04b90b3b9bfb50907aaad', 'request_id': 'req-41014b95-1dfa-454e-ac71-328f40e59cb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.850810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a41bbf6d58c04b90b3b9bfb50907aaad', 'request_id': 'req-41014b95-1dfa-454e-ac71-328f40e59cb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.857082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a41bbf6d58c04b90b3b9bfb50907aaad', 'request_id': 'req-41014b95-1dfa-454e-ac71-328f40e59cb5'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.870275 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] The token cache is being invalidate because project a41bbf6d58c04b90b3b9bfb50907aaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81686) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:04.870570 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.871196 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-41014b95-1dfa-454e-ac71-328f40e59cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:04.872738 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1444/2905] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:04 2022] DELETE /identity/v3/projects/a41bbf6d58c04b90b3b9bfb50907aaad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:04.878582 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.878895 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.879110 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.900005 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:04.901218 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:04.919042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:04.966353 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1462/2906] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:04.974447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:04.974730 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:04.975009 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:04.997548 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:04.998921 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:05.007762 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1445/2907] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:05.012157 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.023224 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5332e-86c2-43f6-83fc-f1e24be21c30 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.028120 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.028735 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.029057 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.029363 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.030017 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81687) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:05.030316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.031969 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.044107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1463/2908] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:05.050004 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.060221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1868598c-518a-47ba-905f-3cc0740c17bb None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.066085 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.066742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.067025 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.067309 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.067997 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.069936 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.098656 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1446/2909] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:05.102924 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.114775 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60899979-3dd8-4241-b1de-311b80236dd8 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.181805 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.182622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.182736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.182972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.183596 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.185578 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.209382 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1464/2910] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:05.213630 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.225030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf3463-9f16-4780-9124-4bec9b4d6625 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.229669 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.230343 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.230556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.230823 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.231464 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.233101 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.244698 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1447/2911] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:05.248742 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.260018 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad85981-e18e-44d0-adaf-939fa4089b71 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.264685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18466a-95f7-471c-b115-377c0c90bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.265288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18466a-95f7-471c-b115-377c0c90bf11 admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.265570 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18466a-95f7-471c-b115-377c0c90bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.265840 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18466a-95f7-471c-b115-377c0c90bf11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.266519 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18466a-95f7-471c-b115-377c0c90bf11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.268165 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac18466a-95f7-471c-b115-377c0c90bf11 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.279132 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1465/2912] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:05.283418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.293773 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f76ea-858a-471c-a2a6-b00b4b0e21b7 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.298852 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.299680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.299983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.300247 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] PATH_INFO: `/v3/projects/8500a7dc698d476d9834076f4df68ecd/users/c0fa5f69b9f440b088efa628eb22a1ea/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.317619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=8500a7dc698d476d9834076f4df68ecd, user_id=c0fa5f69b9f440b088efa628eb22a1ea, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.320294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.334419 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1448/2913] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:05 2022] PUT /identity/v3/projects/8500a7dc698d476d9834076f4df68ecd/users/c0fa5f69b9f440b088efa628eb22a1ea/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:05.345784 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.346064 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.346340 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.375039 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] MFA Rules not processed for user `c0fa5f69b9f440b088efa628eb22a1ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:05.376748 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:05.444254 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1466/2914] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:05.450001 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.472052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:05.521451 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc268714-e14c-46f5-8d25-81c4b8067ede admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.526325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.526938 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.527259 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.527493 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.528157 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.530099 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.558264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1449/2915] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:05.562374 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.573798 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b463bf6-9c05-42af-b7b9-c3aa39679a99 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.586685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:05.634059 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.634574 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.634848 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.635112 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.635737 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.637685 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.659171 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1467/2916] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:05.663377 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.674918 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc8674-0610-4d26-870d-e57585030e6b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.679525 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.680162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.680439 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.680710 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.681348 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.682960 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.693990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1450/2917] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:05.698239 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.708636 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d519be-ac2a-4fed-ae42-7ebd614a6a20 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.713198 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471d143-174b-4649-90fd-99911b1ec9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.713794 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d143-174b-4649-90fd-99911b1ec9ec admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.714069 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d143-174b-4649-90fd-99911b1ec9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.714338 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d143-174b-4649-90fd-99911b1ec9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.714981 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471d143-174b-4649-90fd-99911b1ec9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.716640 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471d143-174b-4649-90fd-99911b1ec9ec admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.727289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1468/2918] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:05.732107 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.742966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0037b-fbfb-47e1-be54-efa20f1bac8d admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.747795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.748491 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.748920 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.749410 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] PATH_INFO: `/v3/projects/2e48a782b0364795834042f0d5205ee4/users/8e5fde287f554671bcd7f4d6ff43a3bd/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.764509 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e48a782b0364795834042f0d5205ee4, user_id=8e5fde287f554671bcd7f4d6ff43a3bd, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.767266 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:05.780176 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1451/2919] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:05 2022] PUT /identity/v3/projects/2e48a782b0364795834042f0d5205ee4/users/8e5fde287f554671bcd7f4d6ff43a3bd/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:05.792045 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.792323 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.792583 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.821478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] MFA Rules not processed for user `8e5fde287f554671bcd7f4d6ff43a3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:05.822827 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:05.895937 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1469/2920] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:05.900416 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:05.972210 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f427c592-7213-4e74-ac2c-2522c27a24d4 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:05.979527 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:05.980264 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:05.980543 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:05.980813 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:05.981450 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:05.983565 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.019442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1452/2921] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:05 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:06.025405 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:06.038458 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f9c58-7699-4d43-83e9-f31578ccd8f9 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:06.116535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:06.117312 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.117584 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.117857 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] PATH_INFO: `/v3/users` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.118535 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:06.120619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.146149 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1470/2922] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:06 2022] POST /identity/v3/users => generated 295 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 31 12:31:06.150623 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:06.161327 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dbb712-04db-4519-ab73-00c20b8fda92 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:06.166188 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:06.166793 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.167073 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.167338 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.168052 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:06.169688 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.182289 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1453/2923] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:06.187409 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:06.204729 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93be53-11c2-4290-9cc7-7175d51e7ece admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:06.209930 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:06.210605 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.210889 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.211167 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] PATH_INFO: `/v3/projects/545ffa148ec94ef09c6adfa280aab567/users/6ece6f4bbf4b4e34a329fe549f71af1e/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.224372 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:06.227831 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=545ffa148ec94ef09c6adfa280aab567, user_id=6ece6f4bbf4b4e34a329fe549f71af1e, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:06.230697 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.244143 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1471/2924] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:06 2022] PUT /identity/v3/projects/545ffa148ec94ef09c6adfa280aab567/users/6ece6f4bbf4b4e34a329fe549f71af1e/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:06.248206 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:06.258502 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f4bd5-b196-4962-a665-ee34392411ec admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:06.301952 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:06.319229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ada5d0-118b-415e-bcb4-03f7857e8302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:06.319840 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada5d0-118b-415e-bcb4-03f7857e8302 admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.320147 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada5d0-118b-415e-bcb4-03f7857e8302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.320418 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ada5d0-118b-415e-bcb4-03f7857e8302 admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.321082 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada5d0-118b-415e-bcb4-03f7857e8302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:06.322716 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ada5d0-118b-415e-bcb4-03f7857e8302 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.333684 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1454/2925] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:06 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:06.338600 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:06.352107 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375918-f153-4543-b8cd-317c2e13d9b3 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:06.356851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:06.357514 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.357792 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.358067 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] PATH_INFO: `/v3/projects/545ffa148ec94ef09c6adfa280aab567/users/6ece6f4bbf4b4e34a329fe549f71af1e/roles/a873026ad8774923ae8b3c5920a3c3aa` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.360639 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] RBAC: Authorizing `identity:create_grant(project_id=545ffa148ec94ef09c6adfa280aab567, user_id=6ece6f4bbf4b4e34a329fe549f71af1e, role_id=a873026ad8774923ae8b3c5920a3c3aa)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:06.363288 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.375181 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1472/2926] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:06 2022] PUT /identity/v3/projects/545ffa148ec94ef09c6adfa280aab567/users/6ece6f4bbf4b4e34a329fe549f71af1e/roles/a873026ad8774923ae8b3c5920a3c3aa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:06.387606 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.387890 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.388325 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.421433 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] MFA Rules not processed for user `6ece6f4bbf4b4e34a329fe549f71af1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:06.423556 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:06.509382 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1455/2927] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 31 12:31:06.522577 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:06.524825 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:06.589325 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbd8f4-5ab5-41df-8d1e-384b59204ead admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:06.593251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:06.593855 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:06.594134 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:06.594972 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:06.655602 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:06.657736 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:06.666984 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1473/2928] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:08.188457 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:08.190315 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:08.202765 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2fd9b-ae11-465b-ac60-eafe57d20418 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:08.207041 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:08.207707 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:08.207922 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:08.208224 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:08.269566 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:08.271007 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:08.280575 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1456/2929] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:08.835464 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:08.846915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eca6402-0dd0-4e0f-b506-db6ed981ccec service cinder] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:08.850622 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d094ca3-1c6d-4fec-b552-d52b6605e2e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:08.851226 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094ca3-1c6d-4fec-b552-d52b6605e2e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:08.851506 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094ca3-1c6d-4fec-b552-d52b6605e2e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:08.851776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d094ca3-1c6d-4fec-b552-d52b6605e2e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:08.860921 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d094ca3-1c6d-4fec-b552-d52b6605e2e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:08.862360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d094ca3-1c6d-4fec-b552-d52b6605e2e0 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:08.878244 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1474/2930] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:12.770505 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:12.834991 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b1c39-4112-48d4-a24d-791217dbbf27 service cinder] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:12.839542 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:12.840186 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:12.840462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:12.840729 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] PATH_INFO: `/v3/users/c0fa5f69b9f440b088efa628eb22a1ea` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:12.841883 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0fa5f69b9f440b088efa628eb22a1ea)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:12.843798 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:12.848506 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=100 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:12.892966 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0fa5f69b9f440b088efa628eb22a1ea'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:12.900442 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0fa5f69b9f440b088efa628eb22a1ea'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:12.901417 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0fa5f69b9f440b088efa628eb22a1ea'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:12.913803 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0fa5f69b9f440b088efa628eb22a1ea'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:12.914467 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0fa5f69b9f440b088efa628eb22a1ea'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:12.930049 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1457/2931] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:12 2022] DELETE /identity/v3/users/c0fa5f69b9f440b088efa628eb22a1ea => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:12.934619 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:12.935080 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:12.935202 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:12.956768 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:12.958317 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:13.020520 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1475/2932] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:13.030207 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.032160 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:13.090942 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77805d-8e69-44a5-bf98-f9bd08f7df04 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:13.095283 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:13.095888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.096197 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.096472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.105810 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:13.107243 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:13.117537 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1458/2933] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:13.394940 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.396428 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:13.409404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61be28-cc1e-4a60-98f5-b06aa5363fc8 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:13.416635 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:13.417395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.417679 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.417957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] PATH_INFO: `/v3/projects/8500a7dc698d476d9834076f4df68ecd` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.419289 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8500a7dc698d476d9834076f4df68ecd)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:13.421566 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:13.439432 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:13.473404 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8500a7dc698d476d9834076f4df68ecd', 'request_id': 'req-667a4d32-43bb-4950-b30f-90fa410fac7e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.479841 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8500a7dc698d476d9834076f4df68ecd', 'request_id': 'req-667a4d32-43bb-4950-b30f-90fa410fac7e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.489053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8500a7dc698d476d9834076f4df68ecd', 'request_id': 'req-667a4d32-43bb-4950-b30f-90fa410fac7e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.500236 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] The token cache is being invalidate because project 8500a7dc698d476d9834076f4df68ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:13.501053 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.501705 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.503230 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1476/2934] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:13 2022] DELETE /identity/v3/projects/8500a7dc698d476d9834076f4df68ecd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:13.507481 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.517657 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22797e-4a4f-470a-b852-4f1c9e3fb27b service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:13.576035 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:13.576671 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:13.576950 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:13.577222 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] PATH_INFO: `/v3/users/8e5fde287f554671bcd7f4d6ff43a3bd` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:13.578358 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5fde287f554671bcd7f4d6ff43a3bd)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:13.580619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:13.612115 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:13.645441 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5fde287f554671bcd7f4d6ff43a3bd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.652835 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5fde287f554671bcd7f4d6ff43a3bd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.653462 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5fde287f554671bcd7f4d6ff43a3bd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.666166 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5fde287f554671bcd7f4d6ff43a3bd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.666878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5fde287f554671bcd7f4d6ff43a3bd'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:13.680837 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1459/2935] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:13 2022] DELETE /identity/v3/users/8e5fde287f554671bcd7f4d6ff43a3bd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:13.970188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:13.971703 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:13.986851 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a4d32-43bb-4950-b30f-90fa410fac7e admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.058988 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.060063 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.060542 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.061009 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] PATH_INFO: `/v3/projects/2e48a782b0364795834042f0d5205ee4` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.062823 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e48a782b0364795834042f0d5205ee4)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.066910 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.119097 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e48a782b0364795834042f0d5205ee4', 'request_id': 'req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.126021 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e48a782b0364795834042f0d5205ee4', 'request_id': 'req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.139847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e48a782b0364795834042f0d5205ee4', 'request_id': 'req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.154395 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] The token cache is being invalidate because project 2e48a782b0364795834042f0d5205ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:14.155662 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.156609 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.158179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1477/2936] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:13 2022] DELETE /identity/v3/projects/2e48a782b0364795834042f0d5205ee4 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:14.162742 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.164706 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:14.184498 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ba215-fda8-49ed-9881-4f9aa60f462b admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.244619 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.245378 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.245695 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.245974 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] PATH_INFO: `/v3/users/6ece6f4bbf4b4e34a329fe549f71af1e` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.247239 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ece6f4bbf4b4e34a329fe549f71af1e)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.249696 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.296704 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ece6f4bbf4b4e34a329fe549f71af1e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.305226 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ece6f4bbf4b4e34a329fe549f71af1e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.305983 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ece6f4bbf4b4e34a329fe549f71af1e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.320162 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ece6f4bbf4b4e34a329fe549f71af1e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.320776 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-82aef94f-f9a0-44b0-8f75-20abfe683866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ece6f4bbf4b4e34a329fe549f71af1e'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.333579 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1460/2937] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:14 2022] DELETE /identity/v3/users/6ece6f4bbf4b4e34a329fe549f71af1e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:14.614902 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.616472 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:14.629950 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b1ac4-4a5f-4a78-acf2-d0d1c0a8d74f admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.663260 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:14.698450 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.699105 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.699360 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.699629 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] PATH_INFO: `/v3/projects/545ffa148ec94ef09c6adfa280aab567` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.700783 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] RBAC: Authorizing `identity:delete_project(project_id=545ffa148ec94ef09c6adfa280aab567)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.702702 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.753540 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '545ffa148ec94ef09c6adfa280aab567', 'request_id': 'req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.759782 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '545ffa148ec94ef09c6adfa280aab567', 'request_id': 'req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.766892 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '545ffa148ec94ef09c6adfa280aab567', 'request_id': 'req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.777293 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] The token cache is being invalidate because project 545ffa148ec94ef09c6adfa280aab567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:14.777581 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.778306 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-8e1c25dd-0dfc-4834-bd53-b7cd4e60437e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:14.779920 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1478/2938] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:14 2022] DELETE /identity/v3/projects/545ffa148ec94ef09c6adfa280aab567 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:14.785389 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.785676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.785949 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.807229 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:14.808490 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:14.827447 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:14.872473 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1461/2939] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:14.880456 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.880740 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.881042 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.901587 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:14.902814 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:14.912066 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1479/2940] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:14.916330 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.926216 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee47b62-6576-4af4-919c-5135ce8b78d7 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.930870 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.931474 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.931747 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.932034 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.932676 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81686) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 31 12:31:14.933046 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.934687 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:14.947076 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1462/2941] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Aug 31 12:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 31 12:31:14.951653 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:14.961852 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae33fd9-417c-4bb9-937d-1fd3f452abfd None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:14.966470 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:14.967071 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:14.967346 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:14.967615 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] PATH_INFO: `/v3/projects` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:14.968316 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:14.970769 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:15.002650 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1480/2942] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Aug 31 12:31:14 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:15.003972 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:15.015044 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae4e8d-a95b-41d3-b169-3ed9cdaf8f8e admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:15.073064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:15.073678 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:15.074043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:15.074221 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] PATH_INFO: `/v3/users` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:15.074865 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:15.076799 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:15.100071 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1463/2943] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Aug 31 12:31:15 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 31 12:31:15.104572 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:15.115170 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fbcbab-556f-46e1-8b14-5bbbc2228878 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:15.119766 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:15.120402 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:15.120684 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:15.120957 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:15.121621 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:15.123251 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:15.133776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1481/2944] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 31 12:31:15.137795 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:15.148914 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a303b00-1e41-496e-89e9-03a7f9cc9190 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:15.154158 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97bc73-a26d-40b1-ba9a-b9ada7888c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:15.154783 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97bc73-a26d-40b1-ba9a-b9ada7888c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:15.155064 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97bc73-a26d-40b1-ba9a-b9ada7888c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:15.155335 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97bc73-a26d-40b1-ba9a-b9ada7888c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:15.155996 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97bc73-a26d-40b1-ba9a-b9ada7888c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:15.158316 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97bc73-a26d-40b1-ba9a-b9ada7888c2f admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:15.169994 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1464/2945] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Aug 31 12:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 31 12:31:15.174471 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:15.184627 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d9799-7f9b-4328-981b-658f077120fa admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:15.189808 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:15.190463 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] REQUEST_METHOD: `PUT` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:15.190744 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:15.191024 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] PATH_INFO: `/v3/projects/74b09af4f80a4dba89a5215cb249b804/users/d74c76c08e68403b84dd2b0418c902b0/roles/f0d96f0a9747490886f58f738e516776` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:15.206914 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b09af4f80a4dba89a5215cb249b804, user_id=d74c76c08e68403b84dd2b0418c902b0, role_id=f0d96f0a9747490886f58f738e516776)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:15.209638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:15.223114 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1482/2946] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Aug 31 12:31:15 2022] PUT /identity/v3/projects/74b09af4f80a4dba89a5215cb249b804/users/d74c76c08e68403b84dd2b0418c902b0/roles/f0d96f0a9747490886f58f738e516776 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:15.233694 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] REQUEST_METHOD: `POST` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:15.233984 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:15.234260 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:15.263714 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.auth.core [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] MFA Rules not processed for user `d74c76c08e68403b84dd2b0418c902b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81686) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:15.264967 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:15.332562 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1465/2947] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:15.346724 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:15.348638 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:15.410090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5270547-b1c7-4ac3-8813-3b8cfc89d211 admin admin] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:15.414179 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2120a93a-90d7-4716-afe2-a072624e22c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5995bbc9449c472ca4f15fc9dddb2092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:15.414847 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a93a-90d7-4716-afe2-a072624e22c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:15.415142 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a93a-90d7-4716-afe2-a072624e22c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:15.415437 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2120a93a-90d7-4716-afe2-a072624e22c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:15.425649 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a93a-90d7-4716-afe2-a072624e22c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:15.427117 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2120a93a-90d7-4716-afe2-a072624e22c0 service cinder] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:15.436416 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1483/2948] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:31:18.028287 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:18.049928 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:18.107538 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0098682-7fdd-4871-a14a-85c66968aae4 None None] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:18.112790 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:18.113472 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:18.113755 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:18.114030 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] PATH_INFO: `/v3/users/d74c76c08e68403b84dd2b0418c902b0` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:18.115204 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d74c76c08e68403b84dd2b0418c902b0)` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:18.117190 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:18.166133 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd74c76c08e68403b84dd2b0418c902b0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.174294 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd74c76c08e68403b84dd2b0418c902b0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.174990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd74c76c08e68403b84dd2b0418c902b0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.187497 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd74c76c08e68403b84dd2b0418c902b0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.189245 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.notifications [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd74c76c08e68403b84dd2b0418c902b0'} {{(pid=81686) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.202040 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1466/2949] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Aug 31 12:31:18 2022] DELETE /identity/v3/users/d74c76c08e68403b84dd2b0418c902b0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:18.206811 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] REQUEST_METHOD: `POST` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:18.207307 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:18.207420 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:18.214343 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:18.230776 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.auth.core [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] MFA Rules not processed for user `b390b55cc108476686d568ade50a7cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81687) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 31 12:31:18.232090 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:18.294663 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1484/2950] 10.222.0.48 () {58 vars in 958 bytes} [Wed Aug 31 12:31:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 31 12:31:18.307043 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:18.308990 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:18.374375 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba7e23d-2b65-46d9-9ddf-2c416e0212d9 admin admin] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:18.378179 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6463d56a7e24d088f6c7a1a8e99139e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:18.378791 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:18.379072 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:18.379346 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:18.398968 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:18.400699 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:18.415680 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1467/2951] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:31:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 31 12:31:18.679478 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] Authenticating user token {{(pid=81687) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:31:18.681188 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.fernet_utils [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81687) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:31:18.698449 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb9b2-12f8-4279-b43d-d1e016c01059 None None] Validating token access rules against request {{(pid=81687) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:31:18.703245 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b390b55cc108476686d568ade50a7cec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b529accab54243219085160b7b1ac0c9', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81687) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:31:18.704041 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:31:18.704320 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:31:18.704919 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] PATH_INFO: `/v3/projects/74b09af4f80a4dba89a5215cb249b804` {{(pid=81687) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:31:18.706036 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b09af4f80a4dba89a5215cb249b804)` {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:31:18.707891 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] RBAC: Authorization granted {{(pid=81687) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:31:18.761078 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b09af4f80a4dba89a5215cb249b804', 'request_id': 'req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.768095 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b09af4f80a4dba89a5215cb249b804', 'request_id': 'req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.776357 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b09af4f80a4dba89a5215cb249b804', 'request_id': 'req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f'} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.789155 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] The token cache is being invalidate because project 74b09af4f80a4dba89a5215cb249b804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81687) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 31 12:31:18.789453 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.790096 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG keystone.notifications [None req-33fec7d2-d1d2-4204-8bc5-5061dffa3b6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81687) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 31 12:31:18.791599 dv-cinder-855359-1-smb devstack@keystone.service[81687]: [pid: 81687|app: 0|req: 1485/2952] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Aug 31 12:31:18 2022] DELETE /identity/v3/projects/74b09af4f80a4dba89a5215cb249b804 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 31 12:31:28.406702 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=70,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:31:28.785915 dv-cinder-855359-1-smb devstack@keystone.service[81687]: DEBUG dbcounter [-] [81687] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 31 12:35:50.141782 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] Authenticating user token {{(pid=81686) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 31 12:35:50.143167 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:50.279477 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f99ad7-d153-49f9-8dfc-e178a8e0b837 service neutron] Validating token access rules against request {{(pid=81686) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 31 12:35:50.337006 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '952511916961431fb58ba2e07e24f4f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9c34c6eaa4b74ce39e7ad65daae8f607', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81686) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 31 12:35:50.337608 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] REQUEST_METHOD: `GET` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 31 12:35:50.337888 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] SCRIPT_NAME: `/identity` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 31 12:35:50.338161 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81686) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 31 12:35:50.339878 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.fernet_utils [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81686) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 31 12:35:50.351426 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 31 12:35:50.353021 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bf006-6204-4812-b76d-eac5df2d9767 service placement] RBAC: Authorization granted {{(pid=81686) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 31 12:35:50.362787 dv-cinder-855359-1-smb devstack@keystone.service[81686]: [pid: 81686|app: 0|req: 1468/2953] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Aug 31 12:35:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 31 12:36:00.358523 dv-cinder-855359-1-smb devstack@keystone.service[81686]: DEBUG dbcounter [-] [81686] Writing DB stats keystone:SELECT=89 {{(pid=81686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}